-- Logs begin at Wed 2022-06-29 07:48:24 UTC, end at Wed 2022-06-29 09:04:06 UTC. -- Jun 29 08:26:42.236304 dv-cinder-797608-37-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 08:26:42.245334 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 08:26:42 2022] *** Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: nodename: dv-cinder-797608-37-iscsi Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: machine: x86_64 Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: clock source: unix Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: pcre jit disabled Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: detected number of CPU cores: 4 Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: current working directory: / Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: detected binary path: /usr/bin/uwsgi-core Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: your processes number limit is 47680 Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: your memory page size is 4096 bytes Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: detected max file descriptor number: 2048 Jun 29 08:26:42.247303 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: lock engine: pthread robust mutexes Jun 29 08:26:42.248166 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: thunder lock: enabled Jun 29 08:26:42.248166 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 08:26:42.248166 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 08:26:42.290908 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: Python main interpreter initialized at 0x563916bdf9c0 Jun 29 08:26:42.290908 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: python threads support enabled Jun 29 08:26:42.290908 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: your server socket listen backlog is limited to 100 connections Jun 29 08:26:42.290908 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: your mercy for graceful operations on workers is 90 seconds Jun 29 08:26:42.291258 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 08:26:42.291258 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: *** Operational MODE: preforking *** Jun 29 08:26:42.291565 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: *** uWSGI is running in multiple interpreter mode *** Jun 29 08:26:42.291565 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: spawned uWSGI master process (pid: 103287) Jun 29 08:26:42.291760 dv-cinder-797608-37-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 08:26:42.292896 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: spawned uWSGI worker 1 (pid: 103288, cores: 1) Jun 29 08:26:42.292896 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: spawned uWSGI worker 2 (pid: 103289, cores: 1) Jun 29 08:26:42.292896 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 08:26:42.935660 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 08:26:42.939171 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 08:26:44.043573 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:26:44.043573 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: from cryptography.utils import int_from_bytes Jun 29 08:26:44.044204 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:26:44.044204 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: from cryptography.utils import int_from_bytes Jun 29 08:26:44.045210 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:26:44.045210 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: from cryptography.utils import int_from_bytes Jun 29 08:26:44.045670 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:26:44.045670 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: from cryptography.utils import int_from_bytes Jun 29 08:26:46.469771 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 08:26:46.470229 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 08:26:46.470537 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 08:26:46.470922 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 08:26:46.471173 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 08:26:46.471552 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.471870 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.472185 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.472499 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.472816 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.473072 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 08:26:46.473479 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.473564 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 08:26:46.473631 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.473752 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.473940 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 08:26:46.474076 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.474239 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 08:26:46.474360 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.474575 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 08:26:46.474750 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.474913 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.475006 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-37-iscsi {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.475243 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.475333 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.475626 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.475719 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.475847 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.475940 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.476151 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.476238 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.476443 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.476529 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.476776 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.476874 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.477078 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.477175 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.477418 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.477542 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.477643 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.478059 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.478127 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.478277 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-37-iscsi {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.478365 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.478588 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.478674 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.478928 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.479153 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.479266 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.479335 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.479524 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.479611 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.479834 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.479938 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.480134 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.480253 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.480443 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.480568 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.480749 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.480958 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.481143 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-37-iscsi {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.481270 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.481452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.481585 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.481755 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.481880 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.482056 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.482175 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.482477 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.482603 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.482755 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.482877 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.483049 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.483173 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.483359 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.483482 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.483684 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.483807 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.483987 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.484126 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.484306 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.484441 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-37-iscsi {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.484616 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.484749 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.484925 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.485052 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.485234 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.485367 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.485527 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.485685 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.485810 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.485996 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.486128 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.486303 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.486437 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.486620 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.486770 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.486979 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.487110 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.487246 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.487376 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.487506 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.487626 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.487819 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.487942 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.488135 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.488268 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.488450 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.488589 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.488710 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.488840 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.488968 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.489090 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.489210 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.489428 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.489704 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.489976 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.490116 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.490245 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.490367 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.490488 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.490618 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.490833 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.490960 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.491080 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.491206 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.491332 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.491470 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.491592 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.491753 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.491885 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.492038 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.492172 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.492305 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.492428 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.492591 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.492716 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.492909 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.493052 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.493221 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.493367 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.493527 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.493635 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.493831 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.493960 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.494151 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.494243 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.494432 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.494516 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.494757 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.494861 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.495071 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.495156 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.495371 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.495455 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.495683 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.495773 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.495995 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.496090 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.496294 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.496380 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.496595 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.496682 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.496895 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.496992 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.497208 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.497294 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.497530 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.497616 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.497823 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.497907 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.498066 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.498160 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.498356 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.498466 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.498650 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.498800 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.498981 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.499120 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.499278 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.499440 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.499576 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.499747 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.499874 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.500054 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.500164 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.500361 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.500446 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.500679 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.500765 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.501014 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.501126 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.501315 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.501408 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.501561 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.501652 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.501862 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.501961 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.502162 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.502248 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.502463 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.503363 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.504224 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.504398 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.504541 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.504679 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.504815 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.505049 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.505543 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.505691 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.505827 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.505962 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.506098 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.506254 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.506404 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.506547 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.506733 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.506884 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.507020 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.507234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.507372 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.507514 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.507649 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.507649 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.507903 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508045 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508181 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508315 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508461 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508461 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508461 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508461 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508461 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.508461 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.509228 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.509360 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.509494 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.509636 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.509770 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.509770 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.510036 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.510181 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.510316 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.510462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.510731 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.510876 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.511012 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.511178 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.511389 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.511539 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.512675 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.512822 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.512955 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.513083 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.513220 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.513354 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.513480 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.513602 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.513722 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.513848 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.513987 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.514114 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.514235 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.514358 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.514480 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.514599 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.514742 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.514870 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.514992 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.515113 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.515246 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.515377 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.515511 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.515641 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.515763 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.515883 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.515995 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.516114 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.516201 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.516312 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.516396 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.516505 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.516597 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.516733 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.516823 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.516962 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.517099 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.517212 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.517305 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.517462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:26:46.517556 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.517681 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.517763 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.517830 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.517923 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.518003 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.518069 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.518145 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.518275 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.518466 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.518629 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.518815 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.518954 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.519089 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.519236 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.519370 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.519516 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.519652 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.519787 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.519951 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.520102 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.520251 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.520402 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.520592 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.520767 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.521038 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.521181 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.521340 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.521586 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.521728 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.521865 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.521999 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.522142 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.522285 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.522432 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.522576 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.522757 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.522900 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.523060 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.523211 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.523358 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.523493 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.523628 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.523848 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.524050 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.524211 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.524372 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.524597 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.524761 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.524901 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.525036 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.525181 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.525317 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.525473 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.525609 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.525743 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.525876 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.526021 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.526156 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.526291 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.526443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.526589 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.526781 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.526934 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.527072 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.527322 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.527472 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.527616 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.527833 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.527980 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.528118 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.528252 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.528386 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.528519 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.528667 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.528810 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.528945 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.529082 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.529235 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.529371 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.529514 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.529657 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.529791 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.529926 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.530060 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.530195 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.530340 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.530485 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.530629 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.530848 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.530985 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.531303 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.531647 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.531919 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.532229 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.532533 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.532837 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.533127 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.533433 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.533736 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.534052 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.534379 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.534671 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.534971 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.535131 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.535269 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.535406 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.535616 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.535794 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.535943 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.536078 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.536348 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.536536 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.536677 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.536840 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.537037 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.537190 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.537342 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.537554 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.537700 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.537847 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.537990 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.538280 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.538429 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.538567 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.538841 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.538997 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.539134 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.539270 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.539421 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.539556 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.539695 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.539845 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.539981 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.540116 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.540250 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.540384 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.540527 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.540663 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.540798 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.540935 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.541070 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.541217 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.541360 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.541504 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.541504 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.541844 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.541984 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.542120 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.542264 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.542399 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.542533 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.542667 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.542833 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.542979 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.543137 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.543273 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.543407 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.543548 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.543688 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.543832 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.543975 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.544119 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.544254 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.544388 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.544530 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.544673 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.544884 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.545031 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.545173 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.545308 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.545441 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.545588 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.545723 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.545858 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.546001 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.546144 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.546279 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.546422 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.546563 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.546741 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.546883 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.547019 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.547019 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.547294 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.547601 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.547906 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.548206 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.548547 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.548851 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.549191 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.549525 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.549844 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.550166 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.550479 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.551394 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.551394 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.551583 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.551665 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.551733 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.551799 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.552040 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.552129 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.552409 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.552627 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.552702 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.552783 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.553056 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.553152 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.553331 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.553481 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.553653 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.553813 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.553958 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.554116 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.554283 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.554431 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.554583 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.554798 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.554950 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.555117 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.555266 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.555466 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.555615 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.555807 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.555897 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.556133 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.556223 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.556464 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.556554 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.556778 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.556883 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.557097 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.557190 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.557405 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.557504 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.557714 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.557805 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.558025 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.558115 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.558342 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.558498 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.558654 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.558864 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.559031 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.559178 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.559315 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.559588 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.559733 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.559907 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.560050 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.560221 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.560361 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.560583 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.560724 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.560859 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.560994 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.561148 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.561291 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.561428 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.561572 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.561753 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.561896 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.562060 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.562209 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.562384 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.562534 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.562714 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.562888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.563030 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.563193 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.563331 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.563499 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.563641 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.563806 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.563948 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.564116 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.564265 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.564423 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.564565 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.564733 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.564884 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.565039 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.565178 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.565343 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.565484 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.565655 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.565807 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.565964 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.566115 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.566282 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.566425 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.566577 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.566755 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.566901 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.567049 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.567279 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.567419 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.567618 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.567813 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.567959 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.568095 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.568267 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.568410 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.568573 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.568747 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.568897 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.569068 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.569222 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.569389 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.569539 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.569684 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.569830 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.569982 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.570127 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.570285 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.570440 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.570577 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.570753 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.571015 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.571222 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.571375 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.571527 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.571665 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.571834 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.571977 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.572225 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.572374 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.572524 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.572660 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.572829 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.572978 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.573142 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.573292 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.573443 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.573586 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.573723 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.573865 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.574018 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.574192 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.574334 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.574502 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.574644 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.574844 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.574987 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.575135 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.575294 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.575454 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.575602 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.575768 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.575910 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.576056 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.576193 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.576337 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.576474 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.576677 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.576829 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.576967 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.577103 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.577273 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.577494 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.577643 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.577833 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.577975 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.578194 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.578337 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.578501 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.578643 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.578835 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.578973 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.579148 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.579299 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.579449 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.579587 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.579739 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.579916 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.580059 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.580250 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.580399 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.580600 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.580753 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.580902 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.581048 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.581209 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.581359 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.581507 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.581645 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.581790 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.581927 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.582088 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.582231 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.582411 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.582561 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.582858 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.583003 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.583295 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.583526 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.583684 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.583833 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.583971 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.584137 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.584280 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.584492 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.584633 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.584780 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.584915 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.585084 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.585227 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.585400 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.585548 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.585713 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.585969 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.586112 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.586296 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.586440 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.586606 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.586796 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.586937 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.587072 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.587230 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.587373 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.587674 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.587830 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.587830 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.588107 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.588253 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.588390 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.588535 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.588678 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.589152 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.589306 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.589444 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.589583 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.589719 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.589864 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.590012 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.590148 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.590285 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.590421 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.590556 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.590724 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.590882 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.591021 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.591157 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.591293 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.591441 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.591586 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.591724 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.591873 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.592010 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.592147 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.592297 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.592435 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.592594 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.592745 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.592981 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.593147 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.593294 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.593486 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.593754 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.593963 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.594188 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.594401 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.594628 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.594881 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.595097 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.595319 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.595539 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.595784 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.596011 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.596251 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.596495 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.596721 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.596953 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.597211 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.597442 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.597783 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.598017 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.598248 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.598481 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.598884 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.599114 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.599340 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.599567 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.599794 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.600034 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.600300 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.600533 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.600762 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.600988 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.601207 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.601458 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.601685 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.601914 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.601914 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.602355 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.602579 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.602849 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.603068 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.603301 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.603462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.603601 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.603738 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.603885 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.604075 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.604298 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.604522 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.604675 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.604813 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.604960 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.605099 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.605236 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.605384 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.605522 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.605668 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.605807 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.605958 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.606103 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.606248 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.606399 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.606553 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.606718 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.606862 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.607010 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.607010 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.607287 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.607433 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.607433 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.607691 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.607925 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.608074 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.608217 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.608368 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.608505 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.608653 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.608799 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.608937 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.609091 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.609240 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.609384 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.609521 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.609656 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.609792 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.609938 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.610083 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.610220 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.610356 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.610500 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.610637 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.610820 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.610991 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.611130 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.611267 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.611402 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.611546 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.611692 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.611838 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.611976 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.612114 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.612257 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.612465 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.612617 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.612769 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.612922 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.613067 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.613209 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.613362 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.613517 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.613661 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.613803 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.613803 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.614074 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.614225 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.614428 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.614579 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.614751 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.614751 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.615058 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.615212 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.615356 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.615498 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.615640 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.615783 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.615935 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.616079 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.616229 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.616391 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.616538 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.616680 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.616910 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.617057 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.617201 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.617343 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.617485 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.617628 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.617778 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.617947 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.618168 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.618320 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.618475 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.618627 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.618841 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.619010 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.619010 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.619283 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.619426 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.619587 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.619734 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.619877 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.620018 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.620160 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.620310 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.620471 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.620621 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.620776 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.620919 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.621062 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.621215 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.621369 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.621521 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.621664 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.621806 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.621949 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.621949 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.622237 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.622237 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.622554 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.622554 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.622859 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.622859 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.623144 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.623294 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.623436 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.623579 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.623722 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.623722 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.624001 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.624144 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.624287 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.624429 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.624584 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.624736 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.624879 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.625022 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.625178 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.625321 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.625465 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.625616 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.625767 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.625909 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.626051 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.626193 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.626349 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.626514 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.626668 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.626862 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.627007 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.627150 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.627312 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.627455 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.627597 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.627747 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.627891 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.628075 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.628313 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.628473 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.628617 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.628760 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.628903 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.629046 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.629198 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.629341 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.629483 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.629632 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.629791 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.629976 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.630177 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.630325 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.630487 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.630630 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.630797 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.630954 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.630954 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.631227 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.631227 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.631504 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.631648 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.631799 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.631799 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.632072 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.632216 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.632368 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.632511 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.632662 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.632806 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.632950 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.633091 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.633241 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.633241 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.633522 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.633666 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.633808 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.633952 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.634094 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.634256 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.634412 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.634558 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.634747 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.634907 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.635051 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.635204 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.635348 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.635489 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.635631 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.635773 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.635915 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.636079 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.636224 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.636392 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.636541 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.636541 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.636828 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.636988 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.637135 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.637278 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.637442 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.637600 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.637745 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.637906 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.638094 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.638249 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.638476 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.638476 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.638476 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.638930 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.639088 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.639232 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.639376 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.639518 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.639669 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.639821 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.639983 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.640139 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.640282 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.640433 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.640587 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.640738 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.640894 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.641038 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.641181 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.641325 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.641468 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.641610 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.641837 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.641994 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.642146 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.642290 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.642434 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.642586 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.642774 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.642923 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.643066 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.643066 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.643338 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.643494 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.643638 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.643782 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.643948 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.644094 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.644237 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.644389 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.644533 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.644676 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.644827 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.644972 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.645115 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.645267 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.645410 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.645575 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.645746 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.645908 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.646066 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.646218 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.646364 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.646508 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.646658 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.646826 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.646991 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.647135 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.647278 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.647422 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.647571 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.647571 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.647863 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.648015 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.648158 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.648300 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.648476 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.648701 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.648850 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.649011 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.649157 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.649300 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.649443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.649595 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.649751 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.649895 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.650038 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.650180 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.650329 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.650481 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.650625 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.650817 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.650963 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.651119 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.651271 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.651424 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.651576 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.651576 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.651869 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.652020 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.652173 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.652319 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.652462 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.652677 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.652826 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.652976 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.653129 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.653274 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.653417 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.653561 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.653714 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.653857 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.654010 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.654167 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.654312 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.654454 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.654597 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.654758 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.654985 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.655132 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.655275 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.655418 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.655571 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.655724 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.655867 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.656013 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.656162 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.656308 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.656451 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.656602 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.656755 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.656898 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.657041 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.657185 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.657327 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.657488 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.657632 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.657775 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.657925 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.658070 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.658213 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.658366 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.658509 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.658653 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.658917 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.659062 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.659217 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.659361 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.659514 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.659681 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.659834 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.659987 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.660143 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.660143 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.660426 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.660578 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.660722 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.660865 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.661015 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.661159 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.661364 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.661527 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.661672 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.661823 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.661975 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.662119 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.662264 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.662414 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.662558 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.662733 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.662884 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.663027 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.663170 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.663327 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.663471 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.663627 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.663773 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.663923 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.664067 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.664218 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.664371 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.664525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.664669 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.664820 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.664964 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.665125 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.665277 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.665423 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.665566 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.665710 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.665853 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.665995 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.666158 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.666319 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.666475 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.666620 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.666812 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.666958 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.667123 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.667274 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.667418 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.667570 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.667715 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.667866 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.668011 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.668155 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.668306 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.668450 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.668594 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.668746 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.668988 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.669137 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.669281 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.669425 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.669568 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.669722 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.669866 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.670016 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.670160 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.670304 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.670456 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.670610 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.670797 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.670953 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.671097 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.671240 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.671397 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.671543 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.671685 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.671830 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.671974 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.672117 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.672269 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.672420 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.672572 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.672737 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.672883 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.673036 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.673188 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.673332 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.673332 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.673604 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.673604 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.673884 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.674032 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.674175 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.674175 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.674465 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.674465 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.674799 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.674951 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.675101 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.675245 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.675397 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.675397 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.675685 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.675827 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.675979 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.676131 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.676290 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.676442 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.676588 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.676730 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.676905 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.677051 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.677201 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.677354 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.677498 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.677640 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.677791 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.677935 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.678087 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.678242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.678385 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.678527 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.678527 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.678823 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.678997 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.679219 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.679367 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.679509 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.679509 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.679779 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.679931 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.680088 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.680232 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.680381 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.680525 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.680667 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.680824 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.680968 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.681111 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.681261 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.681405 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.681555 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.681706 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.681850 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.682011 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.682155 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.682298 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.682516 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.682669 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.682861 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.683006 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.683148 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.683293 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.683447 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.683592 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.683734 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.683885 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.684038 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.684182 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.684334 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.684486 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.684629 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.684772 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.684914 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.685066 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.685066 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.685347 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.685498 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.685642 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.685785 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.685946 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.686101 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.686258 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.686404 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.686553 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.686721 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.686882 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.687027 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.687169 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.687320 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.687465 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.687608 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.687770 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.687922 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.688065 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.688216 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.688360 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.688512 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.688673 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.688816 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.688959 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.689102 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.689325 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.689483 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.689784 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.689928 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.690070 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.690221 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.690374 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.690517 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.690663 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.690851 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.690995 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.691139 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.691300 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.691444 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.691444 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.691730 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.691874 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.692035 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.692198 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.692344 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.692542 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.692696 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.692847 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.693004 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.693147 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.693147 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.693429 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.693574 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.693747 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.693946 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.694101 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.694253 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.694405 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.694549 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.694707 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.694869 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.695021 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.695021 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.695300 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.695450 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.695613 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.695757 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.695900 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.696052 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.696209 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.696353 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.696505 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.696657 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.696800 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.696943 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.697085 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.697238 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.697391 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.697545 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.697688 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.697831 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.697974 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.698129 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.698282 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.698433 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.698602 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.698952 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.699106 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.699263 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.699263 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.699622 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.699767 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.699911 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.699911 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.700192 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.700343 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.700486 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.700629 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.700779 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.700929 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.701083 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.701236 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.701392 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.701546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.701689 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.701845 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.701991 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.702138 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.702282 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.702282 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.702553 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.702553 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.702867 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.703012 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.703156 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.703310 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.703454 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.703607 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.703751 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.703894 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.704044 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.704188 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.704341 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.704493 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.704645 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.704789 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.704939 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.705082 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.705249 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.705395 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.705538 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.705691 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.705843 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.705993 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.706149 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.706294 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.706438 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.706580 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.706745 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.706911 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.707069 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.707211 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.707355 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.707498 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.707655 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.707813 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.707957 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.708136 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.708287 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.708476 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.708710 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.708906 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.709120 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.709288 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.709433 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.709577 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.709723 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.709875 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.710026 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.710170 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.710314 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.710456 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.710685 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.710883 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.711028 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.711183 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.711326 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.711468 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.711628 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.711774 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.711924 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.712068 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.712213 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.712355 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.712507 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.712652 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.712796 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.712939 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.713092 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.713243 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.713389 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.713389 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.713671 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.714147 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.714293 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.714445 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.714597 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.714757 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.714905 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.715050 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.715203 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.715359 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.715503 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.715647 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.715790 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.715790 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.716071 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.716224 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.716368 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.716518 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.716662 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.716813 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.716966 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.717123 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.717274 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.717418 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.717560 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.717703 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.717856 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.718000 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.718144 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.718287 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.718438 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.718589 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.718765 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.718951 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.719125 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.719336 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.719492 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.719636 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.719790 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.719935 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.720078 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.720229 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.720374 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.720526 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.720676 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.720820 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.720976 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.721120 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.721120 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.721400 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.721545 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.721687 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.721829 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.721972 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.722123 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.722300 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.722489 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.722654 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.722875 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.723032 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.723189 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.723360 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.723531 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.723711 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.723958 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.724109 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.724327 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.724488 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.724634 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.724777 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.724922 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.725084 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.725238 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.725389 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.725389 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.725663 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.725805 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.725947 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.725947 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.726243 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.726393 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.726537 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.726679 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.726858 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.727014 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.727157 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.727303 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.727445 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.727596 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.727751 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.727895 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.728038 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.728180 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.728323 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.728466 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.728617 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.728760 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.728914 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.729065 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.729208 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.729376 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.729592 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.729749 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.729895 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 08:26:46.730040 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.730040 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.730040 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.730040 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.730040 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.730040 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.730040 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.731023 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.731023 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.731023 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.731442 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.731442 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.731713 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.731973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.732289 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.732608 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.732949 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.733272 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.733586 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.733906 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.734215 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.734520 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.734879 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:26:46.735158 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 08:26:46.884872 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO dbcounter [None req-c3200303-3936-442e-b48e-af567514e38e None None] Registered counter for database nova_api Jun 29 08:26:46.893073 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO dbcounter [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Registered counter for database nova_api Jun 29 08:26:46.906576 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_db.sqlalchemy.engines [None req-c3200303-3936-442e-b48e-af567514e38e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:26:46.913097 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:26:46.913869 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writer thread running {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:26:46.920082 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writer thread running {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:26:46.969640 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.context [None req-c3200303-3936-442e-b48e-af567514e38e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7545d786-af29-40a6-b32b-77c663f0f8d5(cell1) {{(pid=103288) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 08:26:46.973517 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-c3200303-3936-442e-b48e-af567514e38e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:26:46.975197 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-c3200303-3936-442e-b48e-af567514e38e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:26:46.975890 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.context [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7545d786-af29-40a6-b32b-77c663f0f8d5(cell1) {{(pid=103289) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 08:26:46.976026 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-c3200303-3936-442e-b48e-af567514e38e None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:26:46.977874 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-c3200303-3936-442e-b48e-af567514e38e None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:26:46.979810 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:26:46.979945 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO dbcounter [None req-c3200303-3936-442e-b48e-af567514e38e None None] Registered counter for database nova_cell0 Jun 29 08:26:46.981415 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:26:46.982196 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:26:46.984180 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:26:46.985222 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO dbcounter [None req-c3200303-3936-442e-b48e-af567514e38e None None] Registered counter for database nova_cell1 Jun 29 08:26:46.986176 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO dbcounter [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Registered counter for database nova_cell0 Jun 29 08:26:46.991805 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO dbcounter [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Registered counter for database nova_cell1 Jun 29 08:26:46.993515 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_db.sqlalchemy.engines [None req-c3200303-3936-442e-b48e-af567514e38e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:26:46.995541 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_db.sqlalchemy.engines [None req-c3200303-3936-442e-b48e-af567514e38e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:26:47.002261 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writer thread running {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:26:47.002899 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:26:47.004035 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:26:47.004474 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writer thread running {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:26:47.010682 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writer thread running {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:26:47.012173 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writer thread running {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:26:47.145443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO dbcounter [None req-c3200303-3936-442e-b48e-af567514e38e None None] Registered counter for database nova_cell0 Jun 29 08:26:47.154629 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_db.sqlalchemy.engines [None req-c3200303-3936-442e-b48e-af567514e38e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:26:47.155408 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO dbcounter [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Registered counter for database nova_cell0 Jun 29 08:26:47.159690 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writer thread running {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:26:47.164412 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:26:47.169381 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writer thread running {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:26:47.493209 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: WARNING keystonemiddleware.auth_token [None req-c3200303-3936-442e-b48e-af567514e38e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:26:47.497100 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:26:47.500465 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: WARNING keystonemiddleware.auth_token [None req-c3200303-3936-442e-b48e-af567514e38e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:26:47.504378 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:26:47.841043 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: WARNING keystonemiddleware.auth_token [None req-c3200303-3936-442e-b48e-af567514e38e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:26:47.847036 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: WARNING keystonemiddleware.auth_token [None req-c3200303-3936-442e-b48e-af567514e38e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:26:47.847764 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:26:47.852284 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563916bdf9c0 pid: 103288 (default app) Jun 29 08:26:47.853867 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-40af78a5-9654-41b3-8197-87a156dd7d42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:26:47.854331 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-c3200303-3936-442e-b48e-af567514e38e None None] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:26:47.855543 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-c3200303-3936-442e-b48e-af567514e38e None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Jun 29 08:26:47.856275 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Wed Jun 29 08:26:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:26:47.859098 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563916bdf9c0 pid: 103289 (default app) Jun 29 08:28:03.206218 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-c3200303-3936-442e-b48e-af567514e38e None None] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:03.208054 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-c3200303-3936-442e-b48e-af567514e38e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002241 Jun 29 08:28:03.209029 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:03.221257 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writing DB stats nova_api:SELECT=3 {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:03.222451 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writing DB stats nova_cell0:SELECT=3 {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:03.224193 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writing DB stats nova_cell1:SELECT=3 {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:03.224993 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:03.662459 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1e1b5e39-af9d-4546-8910-73945e0a8951 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:03.691939 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1e1b5e39-af9d-4546-8910-73945e0a8951 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.475601 Jun 29 08:28:03.692974 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1291 bytes} [Wed Jun 29 08:28:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:05.734879 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-c3200303-3936-442e-b48e-af567514e38e None None] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:05.735892 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-c3200303-3936-442e-b48e-af567514e38e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jun 29 08:28:05.736284 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:05.799567 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-ed572b47-992e-4b00-b5b4-9d44efef0418 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:05.818489 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:28:05.818489 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: warnings.warn(msg) Jun 29 08:28:05.854417 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-ed572b47-992e-4b00-b5b4-9d44efef0418 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111819 Jun 29 08:28:05.863008 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 08:28:05.871018 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_api:SELECT=3 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:05.872202 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_cell0:SELECT=3 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:05.873450 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_cell1:SELECT=3 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:05.874347 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:06.084904 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-d1ddcfdb-defb-4927-9222-760f0cfda5b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:06.087471 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:28:06.087471 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: warnings.warn(msg) Jun 29 08:28:06.152557 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-d1ddcfdb-defb-4927-9222-760f0cfda5b1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287272 Jun 29 08:28:06.153148 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1335 bytes} [Wed Jun 29 08:28:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:08.197598 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-ed572b47-992e-4b00-b5b4-9d44efef0418 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:08.199547 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-ed572b47-992e-4b00-b5b4-9d44efef0418 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Jun 29 08:28:08.200419 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:08.320869 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-0762eec9-edfd-436e-80b3-0f10b2ea7807 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "disk": 5}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:08.340050 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:28:08.340050 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: warnings.warn(msg) Jun 29 08:28:08.361289 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-0762eec9-edfd-436e-80b3-0f10b2ea7807 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154381 Jun 29 08:28:08.361861 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:28:08.374310 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-3d3ec75a-0f6b-4d41-947b-93e0a4ff0479 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:08.375830 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:28:08.375830 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: warnings.warn(msg) Jun 29 08:28:08.414534 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-3d3ec75a-0f6b-4d41-947b-93e0a4ff0479 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043899 Jun 29 08:28:08.415276 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1335 bytes} [Wed Jun 29 08:28:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:10.515429 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-0762eec9-edfd-436e-80b3-0f10b2ea7807 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:10.516454 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-0762eec9-edfd-436e-80b3-0f10b2ea7807 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jun 29 08:28:10.516869 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:10.580828 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-7b83b7f4-66e5-4fb4-b742-2be559c828d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "vcpus": 1, "disk": 10}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:10.603082 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-7b83b7f4-66e5-4fb4-b742-2be559c828d7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080128 Jun 29 08:28:10.603944 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 08:28:10.616445 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-eae8b537-0a79-4f83-98fb-5188a69e5f38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:10.641808 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-eae8b537-0a79-4f83-98fb-5188a69e5f38 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029319 Jun 29 08:28:10.651046 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1335 bytes} [Wed Jun 29 08:28:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:12.723418 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-7b83b7f4-66e5-4fb4-b742-2be559c828d7 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:12.724473 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-7b83b7f4-66e5-4fb4-b742-2be559c828d7 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001739 Jun 29 08:28:12.724871 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:12.786297 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-ddfd4467-7b88-4084-a3f6-0cba843c5caa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "disk": 10, "ram": 2048, "name": "ds2G"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:12.806222 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-ddfd4467-7b88-4084-a3f6-0cba843c5caa admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075305 Jun 29 08:28:12.806669 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 08:28:12.818958 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1c6310f0-3660-43cb-99cf-ff720ff047ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:12.842938 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1c6310f0-3660-43cb-99cf-ff720ff047ef admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027743 Jun 29 08:28:12.843508 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1335 bytes} [Wed Jun 29 08:28:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:14.973471 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-ddfd4467-7b88-4084-a3f6-0cba843c5caa admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:14.974503 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-ddfd4467-7b88-4084-a3f6-0cba843c5caa admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Jun 29 08:28:14.974950 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:15.039106 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-0cbae953-50ab-426f-9902-d8cdb73bad5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:15.059898 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-0cbae953-50ab-426f-9902-d8cdb73bad5e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078948 Jun 29 08:28:15.060450 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:28:15.072511 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-92c49e30-b542-4c20-ac4f-c36b48f9e116 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:15.098970 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-92c49e30-b542-4c20-ac4f-c36b48f9e116 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030057 Jun 29 08:28:15.099536 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1335 bytes} [Wed Jun 29 08:28:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:17.174496 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-0cbae953-50ab-426f-9902-d8cdb73bad5e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:17.175725 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-0cbae953-50ab-426f-9902-d8cdb73bad5e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jun 29 08:28:17.177702 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:17.237501 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-31572ed8-0ef2-47e7-8974-819ec77bccd5 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:17.260912 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-31572ed8-0ef2-47e7-8974-819ec77bccd5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078316 Jun 29 08:28:17.261805 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1291 bytes} [Wed Jun 29 08:28:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:28:19.328160 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-0cbae953-50ab-426f-9902-d8cdb73bad5e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:19.329189 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-0cbae953-50ab-426f-9902-d8cdb73bad5e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 29 08:28:19.329613 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:19.390805 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-373baade-02bb-41fa-b0a9-25b2fe9e03d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "swap": 0}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:19.412506 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-373baade-02bb-41fa-b0a9-25b2fe9e03d2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076544 Jun 29 08:28:19.413170 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:28:19.426955 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-98bf5b94-96a3-4830-b472-e6a83b8be4c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:19.453627 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-98bf5b94-96a3-4830-b472-e6a83b8be4c8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031167 Jun 29 08:28:19.454248 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1332 bytes} [Wed Jun 29 08:28:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:21.643434 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-373baade-02bb-41fa-b0a9-25b2fe9e03d2 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:21.644840 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-373baade-02bb-41fa-b0a9-25b2fe9e03d2 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jun 29 08:28:21.645052 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:21.709244 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-a554cabf-3c41-4ba6-b66c-16cac7640c96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:21.728950 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-a554cabf-3c41-4ba6-b66c-16cac7640c96 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077548 Jun 29 08:28:21.729542 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 08:28:21.741980 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-f2490cdb-0f94-47c1-afe2-533304d49db9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:21.766717 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-f2490cdb-0f94-47c1-afe2-533304d49db9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028590 Jun 29 08:28:21.767369 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1332 bytes} [Wed Jun 29 08:28:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:28:23.878249 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-a554cabf-3c41-4ba6-b66c-16cac7640c96 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:23.880175 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-a554cabf-3c41-4ba6-b66c-16cac7640c96 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002651 Jun 29 08:28:23.880926 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:23.971956 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-5c8306d5-ce67-4fd9-a6e1-6aa9a6cfbc91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:24.001920 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-5c8306d5-ce67-4fd9-a6e1-6aa9a6cfbc91 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.114122 Jun 29 08:28:24.002978 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:28:24.015263 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-a7f5776b-7f59-4256-9db3-03dafd00554e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:24.043063 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-a7f5776b-7f59-4256-9db3-03dafd00554e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031114 Jun 29 08:28:24.044090 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1332 bytes} [Wed Jun 29 08:28:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:26.422880 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-5c8306d5-ce67-4fd9-a6e1-6aa9a6cfbc91 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:26.423895 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-5c8306d5-ce67-4fd9-a6e1-6aa9a6cfbc91 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jun 29 08:28:26.424264 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:26.487023 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-41e04f08-fe6a-4410-bf6a-87330a734ae1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:26.506186 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-41e04f08-fe6a-4410-bf6a-87330a734ae1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075933 Jun 29 08:28:26.506758 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:28:26.518933 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-9a5f897a-122f-4180-a5d0-fddd8f4faddd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:26.543532 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-9a5f897a-122f-4180-a5d0-fddd8f4faddd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028296 Jun 29 08:28:26.544111 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1332 bytes} [Wed Jun 29 08:28:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:28.622260 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-41e04f08-fe6a-4410-bf6a-87330a734ae1 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:28.623384 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-41e04f08-fe6a-4410-bf6a-87330a734ae1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Jun 29 08:28:28.626317 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:28.694919 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-127f22fb-41b7-48c2-800e-f81be71b1e77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:28.713729 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-127f22fb-41b7-48c2-800e-f81be71b1e77 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079429 Jun 29 08:28:28.715012 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1282 bytes} [Wed Jun 29 08:28:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 08:28:28.731003 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-011bd9b8-b3c9-46a5-a348-64619d8a9986 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:28.791437 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-011bd9b8-b3c9-46a5-a348-64619d8a9986 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067734 Jun 29 08:28:28.792005 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1332 bytes} [Wed Jun 29 08:28:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:28:53.125016 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-127f22fb-41b7-48c2-800e-f81be71b1e77 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:53.126741 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-127f22fb-41b7-48c2-800e-f81be71b1e77 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Jun 29 08:28:53.127335 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:53.140590 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:53.193538 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-4140430d-aafe-4ca0-83ac-0a93125a7c03 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:53.210410 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-4140430d-aafe-4ca0-83ac-0a93125a7c03 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076169 Jun 29 08:28:53.210975 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1291 bytes} [Wed Jun 29 08:28:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:28:54.163736 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-127f22fb-41b7-48c2-800e-f81be71b1e77 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:54.165326 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-127f22fb-41b7-48c2-800e-f81be71b1e77 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Jun 29 08:28:54.165927 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:54.384689 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-7548cada-4751-402d-a695-b8d60b2aed83 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:54.390598 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-7548cada-4751-402d-a695-b8d60b2aed83 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-7548cada-4751-402d-a695-b8d60b2aed83 admin admin] Request method failure captured: Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Accept: application/json Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Accept-Encoding: gzip, deflate Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Connection: keep-alive Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Content-Length: 0 Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Host: 10.222.0.27 Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Openstack-Api-Version: compute 2.90 Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Openstack-System-Scope: None Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: User-Agent: python-novaclient Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Auth-Token: gAAAAABivA1GTemufuXrM6x-jAQZbo_ZK5NOs3QVBrHB04VgjQSLU2thw9otTXQiM1xruME5NtBlOcPFgflBWufM4h75rYsc3ocQS3Fjp5vvbvCWsgfJl4UwFacwhLmi2xz_B_hkCT0Ofus9m8vg3BhLCDvXX_-c_cyfZ5xdQ6nEdQF6ZGdX_JM Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Domain-Id: None Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Domain-Name: None Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Identity-Status: Confirmed Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Is-Admin-Project: True Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Domain-Id: default Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Domain-Name: Default Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Name: admin Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Role: reader,admin,member Jun 29 08:28:54.393973 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Roles: reader,admin,member Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b8a36f8c21e4c4f9394d7b2d795e615"}]}] Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant: admin Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant-Name: admin Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User: admin Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Domain-Id: default Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Domain-Name: Default Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Id: c145cd66ea9b4d3a85c89c24f585acff Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Name: admin Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: method: > Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: exception: Flavor 42 could not be found. Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: action_args: {'id': '42'} Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:28:54.395546 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:54.396837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.398227 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-7548cada-4751-402d-a695-b8d60b2aed83 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:28:54.399658 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-7548cada-4751-402d-a695-b8d60b2aed83 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.092333 Jun 29 08:28:54.399658 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Jun 29 08:28:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 08:28:54.405887 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-ece6e49b-c806-49cb-b474-301daccf905a admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:54.409104 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:28:54.428722 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-ece6e49b-c806-49cb-b474-301daccf905a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026576 Jun 29 08:28:54.429250 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Jun 29 08:28:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:28:54.439189 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-f2d98e46-d0ad-4298-9ce1-73a42a5a0eb8 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:54.460762 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-f2d98e46-d0ad-4298-9ce1-73a42a5a0eb8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025101 Jun 29 08:28:54.461754 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Jun 29 08:28:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:28:54.471802 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-2f911fa6-1e8b-48c5-8c0e-c3a4e3c89aed admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:54.478052 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.wsgi [None req-2f911fa6-1e8b-48c5-8c0e-c3a4e3c89aed admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-2f911fa6-1e8b-48c5-8c0e-c3a4e3c89aed admin admin] Request method failure captured: Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Accept: application/json Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Accept-Encoding: gzip, deflate Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Connection: keep-alive Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Content-Length: 0 Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Host: 10.222.0.27 Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Openstack-Api-Version: compute 2.90 Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Openstack-System-Scope: None Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: User-Agent: python-novaclient Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Auth-Token: gAAAAABivA1GTemufuXrM6x-jAQZbo_ZK5NOs3QVBrHB04VgjQSLU2thw9otTXQiM1xruME5NtBlOcPFgflBWufM4h75rYsc3ocQS3Fjp5vvbvCWsgfJl4UwFacwhLmi2xz_B_hkCT0Ofus9m8vg3BhLCDvXX_-c_cyfZ5xdQ6nEdQF6ZGdX_JM Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Domain-Id: None Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Domain-Name: None Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Identity-Status: Confirmed Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Is-Admin-Project: True Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Domain-Id: default Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Domain-Name: Default Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Name: admin Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Role: reader,admin,member Jun 29 08:28:54.481387 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Roles: reader,admin,member Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b8a36f8c21e4c4f9394d7b2d795e615"}]}] Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant: admin Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant-Name: admin Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User: admin Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Domain-Id: default Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Domain-Name: Default Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Id: c145cd66ea9b4d3a85c89c24f585acff Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Name: admin Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: method: > Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: exception: Flavor 42 could not be found. Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: action_args: {'id': '42'} Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:28:54.482810 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:54.483811 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:54.484918 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-2f911fa6-1e8b-48c5-8c0e-c3a4e3c89aed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:28:54.485898 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-2f911fa6-1e8b-48c5-8c0e-c3a4e3c89aed admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014930 Jun 29 08:28:54.485898 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Jun 29 08:28:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 08:28:55.319854 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-f2d98e46-d0ad-4298-9ce1-73a42a5a0eb8 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:55.320878 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-f2d98e46-d0ad-4298-9ce1-73a42a5a0eb8 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 29 08:28:55.321262 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:55.511418 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-bff0fa8e-2ae7-4109-b7cd-7b197c95707c admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:55.517359 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.wsgi [None req-bff0fa8e-2ae7-4109-b7cd-7b197c95707c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-bff0fa8e-2ae7-4109-b7cd-7b197c95707c admin admin] Request method failure captured: Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Accept: application/json Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Accept-Encoding: gzip, deflate Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Connection: keep-alive Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Content-Length: 0 Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Host: 10.222.0.27 Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Openstack-Api-Version: compute 2.90 Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Openstack-System-Scope: None Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: User-Agent: python-novaclient Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Auth-Token: gAAAAABivA1HjfH7AuTRjTbxatlhxUfB92tphsEm0XcYC6JiUtBLPZ9qB-dtt6wkh24rSnYozBin_br8A_FFIgWzd9SDkGhzAnQaLvAgJJq6Qtt8FR-vbMQATuuUQNOSZxNT3VGpeer4eqFJ4YFy9P4AtUidow2G6P3QYMfH_gkvwQdz-tVSG40 Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Domain-Id: None Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Domain-Name: None Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Identity-Status: Confirmed Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Is-Admin-Project: True Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Domain-Id: default Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Domain-Name: Default Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Name: admin Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Role: reader,admin,member Jun 29 08:28:55.518882 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Roles: reader,admin,member Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b8a36f8c21e4c4f9394d7b2d795e615"}]}] Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant: admin Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant-Name: admin Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User: admin Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Domain-Id: default Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Domain-Name: Default Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Id: c145cd66ea9b4d3a85c89c24f585acff Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Name: admin Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: method: > Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: exception: Flavor 84 could not be found. Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: action_args: {'id': '84'} Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:28:55.520462 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:55.523463 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.524520 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-bff0fa8e-2ae7-4109-b7cd-7b197c95707c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:28:55.525582 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-bff0fa8e-2ae7-4109-b7cd-7b197c95707c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063492 Jun 29 08:28:55.525582 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Jun 29 08:28:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 08:28:55.530330 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-f84c47fd-f84a-47cd-8ff4-a71c03e44773 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:55.546178 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-f84c47fd-f84a-47cd-8ff4-a71c03e44773 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019524 Jun 29 08:28:55.546735 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Jun 29 08:28:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:28:55.558164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-89bd51a2-410d-4765-8e9e-ad2b84a6d037 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:55.573611 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-89bd51a2-410d-4765-8e9e-ad2b84a6d037 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018944 Jun 29 08:28:55.574128 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Jun 29 08:28:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:28:55.583582 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1c5c9d2f-ae15-417c-8045-e1bbc5093412 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:55.589864 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-1c5c9d2f-ae15-417c-8045-e1bbc5093412 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1c5c9d2f-ae15-417c-8045-e1bbc5093412 admin admin] Request method failure captured: Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Accept: application/json Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Accept-Encoding: gzip, deflate Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Connection: keep-alive Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Content-Length: 0 Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Host: 10.222.0.27 Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Openstack-Api-Version: compute 2.90 Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Openstack-System-Scope: None Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: User-Agent: python-novaclient Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Auth-Token: gAAAAABivA1HjfH7AuTRjTbxatlhxUfB92tphsEm0XcYC6JiUtBLPZ9qB-dtt6wkh24rSnYozBin_br8A_FFIgWzd9SDkGhzAnQaLvAgJJq6Qtt8FR-vbMQATuuUQNOSZxNT3VGpeer4eqFJ4YFy9P4AtUidow2G6P3QYMfH_gkvwQdz-tVSG40 Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Domain-Id: None Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Domain-Name: None Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Identity-Status: Confirmed Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Is-Admin-Project: True Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Domain-Id: default Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Domain-Name: Default Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Name: admin Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Role: reader,admin,member Jun 29 08:28:55.591422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Roles: reader,admin,member Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b8a36f8c21e4c4f9394d7b2d795e615"}]}] Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant: admin Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant-Name: admin Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User: admin Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Domain-Id: default Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Domain-Name: Default Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Id: c145cd66ea9b4d3a85c89c24f585acff Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Name: admin Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: method: > Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: exception: Flavor 84 could not be found. Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: action_args: {'id': '84'} Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:28:55.592888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:55.593818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:55.595242 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1c5c9d2f-ae15-417c-8045-e1bbc5093412 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:28:55.596476 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1c5c9d2f-ae15-417c-8045-e1bbc5093412 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012982 Jun 29 08:28:55.596476 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Jun 29 08:28:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 08:28:56.444093 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-89bd51a2-410d-4765-8e9e-ad2b84a6d037 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:56.445111 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-89bd51a2-410d-4765-8e9e-ad2b84a6d037 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002388 Jun 29 08:28:56.445513 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:28:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:56.668134 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-80735aef-9671-431c-ad34-88dc125b1e75 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:56.674473 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-80735aef-9671-431c-ad34-88dc125b1e75 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-80735aef-9671-431c-ad34-88dc125b1e75 admin admin] Request method failure captured: Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Accept: application/json Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Accept-Encoding: gzip, deflate Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Connection: keep-alive Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Content-Length: 0 Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Host: 10.222.0.27 Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Openstack-Api-Version: compute 2.90 Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Openstack-System-Scope: None Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: User-Agent: python-novaclient Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Auth-Token: gAAAAABivA1IvLmc0q5oWn00-Q9ZYBzNePTtrQUlLnlDPEDzvRrDG-yO06bZ9FdGrGQrx_WB_4jc8NXs7KTBrSV7MnH4gN4CJDZmMLT_07-ekIn0Dul344OBVGgM3ZG4qclffjFNDrTdRH885VTH3RRh_H03ptp7st3RQ--JSvo0iC-BVDAVaH8 Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Domain-Id: None Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Domain-Name: None Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Identity-Status: Confirmed Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Is-Admin-Project: True Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Domain-Id: default Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Domain-Name: Default Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Project-Name: admin Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Role: reader,admin,member Jun 29 08:28:56.676017 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Roles: reader,admin,member Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b8a36f8c21e4c4f9394d7b2d795e615"}]}] Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant: admin Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-Tenant-Name: admin Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User: admin Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Domain-Id: default Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Domain-Name: Default Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Id: c145cd66ea9b4d3a85c89c24f585acff Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: X-User-Name: admin Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: method: > Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: exception: Flavor 451 could not be found. Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: action_args: {'id': '451'} Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:28:56.677525 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:56.678452 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.679818 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-80735aef-9671-431c-ad34-88dc125b1e75 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:28:56.681027 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-80735aef-9671-431c-ad34-88dc125b1e75 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.089604 Jun 29 08:28:56.681225 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Jun 29 08:28:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 08:28:56.687286 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-ffc43b58-b53a-48d4-a11e-7e94e55a7db0 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:56.701499 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-ffc43b58-b53a-48d4-a11e-7e94e55a7db0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017762 Jun 29 08:28:56.702020 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Jun 29 08:28:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:28:56.711449 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:56.726047 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018056 Jun 29 08:28:56.726562 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Jun 29 08:28:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:28:56.735964 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-f6b93e42-2b9d-47b7-acaf-4983fa736c80 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:56.741598 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.wsgi [None req-f6b93e42-2b9d-47b7-acaf-4983fa736c80 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-f6b93e42-2b9d-47b7-acaf-4983fa736c80 admin admin] Request method failure captured: Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Accept: application/json Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Accept-Encoding: gzip, deflate Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Connection: keep-alive Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Content-Length: 0 Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Host: 10.222.0.27 Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Openstack-Api-Version: compute 2.90 Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Openstack-System-Scope: None Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: User-Agent: python-novaclient Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Auth-Token: gAAAAABivA1IvLmc0q5oWn00-Q9ZYBzNePTtrQUlLnlDPEDzvRrDG-yO06bZ9FdGrGQrx_WB_4jc8NXs7KTBrSV7MnH4gN4CJDZmMLT_07-ekIn0Dul344OBVGgM3ZG4qclffjFNDrTdRH885VTH3RRh_H03ptp7st3RQ--JSvo0iC-BVDAVaH8 Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Domain-Id: None Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Domain-Name: None Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Identity-Status: Confirmed Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Is-Admin-Project: True Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Domain-Id: default Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Domain-Name: Default Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Project-Name: admin Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Role: reader,admin,member Jun 29 08:28:56.743164 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Roles: reader,admin,member Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8a36f8c21e4c4f9394d7b2d795e615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b8a36f8c21e4c4f9394d7b2d795e615"}]}] Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant: admin Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant-Id: 3b8a36f8c21e4c4f9394d7b2d795e615 Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-Tenant-Name: admin Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User: admin Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Domain-Id: default Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Domain-Name: Default Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Id: c145cd66ea9b4d3a85c89c24f585acff Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: X-User-Name: admin Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: method: > Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: exception: Flavor 451 could not be found. Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: action_args: {'id': '451'} Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:28:56.744443 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:56.745234 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: ERROR nova.api.openstack.wsgi Jun 29 08:28:56.746333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-f6b93e42-2b9d-47b7-acaf-4983fa736c80 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:28:56.747525 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-f6b93e42-2b9d-47b7-acaf-4983fa736c80 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011998 Jun 29 08:28:56.747525 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Jun 29 08:28:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 08:28:57.576654 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:57.577702 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 29 08:28:57.578151 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:57.784549 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-7172d14e-9b65-45ae-ba58-ef9d7f7a77ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:57.809765 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-7172d14e-9b65-45ae-ba58-ef9d7f7a77ca admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.093716 Jun 29 08:28:57.810321 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Jun 29 08:28:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:28:58.640705 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:58.641775 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 29 08:28:58.642194 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:28:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:58.839714 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-fa21ef8a-0a10-4b0a-acac-ed9eadcfca90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:58.860893 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-fa21ef8a-0a10-4b0a-acac-ed9eadcfca90 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080418 Jun 29 08:28:58.861442 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Jun 29 08:28:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 08:28:59.693250 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:28:59.694422 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Jun 29 08:28:59.694837 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:28:59.905484 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-ce8a99e7-05ae-4a0d-86bc-c6f99153356a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:28:59.930143 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-ce8a99e7-05ae-4a0d-86bc-c6f99153356a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.092227 Jun 29 08:28:59.930727 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Jun 29 08:28:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:29:00.761445 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:00.762772 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Jun 29 08:29:00.763328 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:29:00.965631 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-8665c82d-e8b4-4f23-986a-af8bb73e9483 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:29:00.988898 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-8665c82d-e8b4-4f23-986a-af8bb73e9483 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.086236 Jun 29 08:29:00.989435 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Jun 29 08:29:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:29:01.827664 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:01.828792 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jun 29 08:29:01.829185 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:29:02.030935 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-9132a8fb-f332-401b-8f59-e376dcfcf7cd admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:02.058675 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-9132a8fb-f332-401b-8f59-e376dcfcf7cd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.093639 Jun 29 08:29:02.059165 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Wed Jun 29 08:29:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:29:49.058271 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:49.059324 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-b871eab3-0709-41b5-a8d0-6be5f000374e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 29 08:29:49.059722 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 930 bytes} [Wed Jun 29 08:29:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:29:49.070323 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:29:49.121575 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-6ab1c533-7f1b-4265-a218-1ae6194998c6 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:49.140995 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-6ab1c533-7f1b-4265-a218-1ae6194998c6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075315 Jun 29 08:29:49.141526 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1291 bytes} [Wed Jun 29 08:29:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:29:49.164470 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-81d7d16a-3815-4686-870b-19a6bab7f44d admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:49.167979 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG dbcounter [-] [103289] Writing DB stats nova_api:SELECT=14 {{(pid=103289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:29:49.173273 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-81d7d16a-3815-4686-870b-19a6bab7f44d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012455 Jun 29 08:29:49.173796 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1282 bytes} [Wed Jun 29 08:29:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:29:49.185421 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-f24824db-7e0c-482a-9a8b-5c58e52bbbf2 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:49.193661 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-f24824db-7e0c-482a-9a8b-5c58e52bbbf2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011856 Jun 29 08:29:49.194176 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1285 bytes} [Wed Jun 29 08:29:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:29:49.205562 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:49.213375 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011587 Jun 29 08:29:49.213888 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1285 bytes} [Wed Jun 29 08:29:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:29:49.225196 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-05b75570-3a50-48fd-be3b-0bd8ed34556a admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:29:49.234407 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-05b75570-3a50-48fd-be3b-0bd8ed34556a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012621 Jun 29 08:29:49.234999 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1282 bytes} [Wed Jun 29 08:29:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:33:03.312502 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:33:03.313543 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 29 08:33:03.313939 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:33:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:33:03.453288 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_api:SELECT=6 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:33:03.579239 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-252c93a4-a2cf-4e2b-8b3a-cde964d2c49d admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:33:03.580921 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:33:03.580921 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: warnings.warn(msg) Jun 29 08:33:03.582154 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-252c93a4-a2cf-4e2b-8b3a-cde964d2c49d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:33:03.582588 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-252c93a4-a2cf-4e2b-8b3a-cde964d2c49d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:33:03.583349 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-252c93a4-a2cf-4e2b-8b3a-cde964d2c49d admin admin] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:33:03.583789 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-252c93a4-a2cf-4e2b-8b3a-cde964d2c49d admin admin] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:33:03.617751 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-252c93a4-a2cf-4e2b-8b3a-cde964d2c49d admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.166196 Jun 29 08:33:03.618312 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Jun 29 08:33:03 2022] GET /compute/v2.1/os-services => generated 794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:33:04.464136 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:33:04.465500 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Jun 29 08:33:04.465892 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:33:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:33:04.674727 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-fbce9524-7ad7-4ad7-93d7-4547410fa9e9 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:33:04.675902 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:33:04.675902 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: warnings.warn(msg) Jun 29 08:33:04.677117 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-fbce9524-7ad7-4ad7-93d7-4547410fa9e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:33:04.677555 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-fbce9524-7ad7-4ad7-93d7-4547410fa9e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:33:04.678333 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-fbce9524-7ad7-4ad7-93d7-4547410fa9e9 admin admin] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:33:04.678778 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-fbce9524-7ad7-4ad7-93d7-4547410fa9e9 admin admin] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:33:04.697952 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-fbce9524-7ad7-4ad7-93d7-4547410fa9e9 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.091950 Jun 29 08:33:04.698496 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Jun 29 08:33:04 2022] GET /compute/v2.1/os-services => generated 794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:33:15.975762 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:33:15.976951 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Jun 29 08:33:15.977477 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:33:16.120720 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_cell0:SELECT=4 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:33:16.121433 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_cell1:SELECT=4 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:33:16.122075 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG dbcounter [-] [103288] Writing DB stats nova_api:SELECT=8 {{(pid=103288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:33:16.173911 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-0b6309df-e32e-44ad-981f-1a3636b9dcd2 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:33:16.175178 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:33:16.175178 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: warnings.warn(msg) Jun 29 08:33:16.176292 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-0b6309df-e32e-44ad-981f-1a3636b9dcd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:33:16.176723 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-0b6309df-e32e-44ad-981f-1a3636b9dcd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:33:16.177489 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-0b6309df-e32e-44ad-981f-1a3636b9dcd2 admin admin] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:33:16.177910 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-0b6309df-e32e-44ad-981f-1a3636b9dcd2 admin admin] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:33:16.202288 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-0b6309df-e32e-44ad-981f-1a3636b9dcd2 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086089 Jun 29 08:33:16.202857 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Jun 29 08:33:16 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:33:17.036362 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:33:17.037401 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-d1c3d94b-ca21-4137-a820-94748542d4c0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 29 08:33:17.037811 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Jun 29 08:33:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:33:17.240691 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-501a9cc1-4dae-49aa-907c-625bcbe7ea70 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:33:17.242709 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:33:17.242709 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: warnings.warn(msg) Jun 29 08:33:17.244539 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-501a9cc1-4dae-49aa-907c-625bcbe7ea70 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:33:17.244978 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-501a9cc1-4dae-49aa-907c-625bcbe7ea70 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:33:17.245770 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-501a9cc1-4dae-49aa-907c-625bcbe7ea70 admin admin] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:33:17.246194 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-501a9cc1-4dae-49aa-907c-625bcbe7ea70 admin admin] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:33:17.267781 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-501a9cc1-4dae-49aa-907c-625bcbe7ea70 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.090843 Jun 29 08:33:17.268342 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Jun 29 08:33:17 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:34:14.315874 dv-cinder-797608-37-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 29 08:34:14.316663 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: Wed Jun 29 08:34:14 2022 - graceful shutdown triggered... Jun 29 08:34:14.317490 dv-cinder-797608-37-iscsi devstack@n-api.service[103288]: Gracefully killing worker 1 (pid: 103288)... Jun 29 08:34:14.317856 dv-cinder-797608-37-iscsi devstack@n-api.service[103289]: Gracefully killing worker 2 (pid: 103289)... Jun 29 08:34:15.317295 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: worker 1 buried after 1 seconds Jun 29 08:34:15.317295 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: worker 2 buried after 1 seconds Jun 29 08:34:15.317295 dv-cinder-797608-37-iscsi devstack@n-api.service[103287]: goodbye to uWSGI. Jun 29 08:34:15.319895 dv-cinder-797608-37-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 29 08:34:15.320788 dv-cinder-797608-37-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 29 08:34:15.325211 dv-cinder-797608-37-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 08:34:15.342893 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 08:34:15 2022] *** Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: nodename: dv-cinder-797608-37-iscsi Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: machine: x86_64 Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: clock source: unix Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: pcre jit disabled Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: detected number of CPU cores: 4 Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: current working directory: / Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: detected binary path: /usr/bin/uwsgi-core Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: your processes number limit is 47680 Jun 29 08:34:15.346174 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: your memory page size is 4096 bytes Jun 29 08:34:15.347738 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: detected max file descriptor number: 2048 Jun 29 08:34:15.347738 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: lock engine: pthread robust mutexes Jun 29 08:34:15.347738 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: thunder lock: enabled Jun 29 08:34:15.347738 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 08:34:15.347738 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 08:34:15.392218 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: Python main interpreter initialized at 0x55b0bea579c0 Jun 29 08:34:15.392218 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: python threads support enabled Jun 29 08:34:15.392218 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: your server socket listen backlog is limited to 100 connections Jun 29 08:34:15.392218 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: your mercy for graceful operations on workers is 90 seconds Jun 29 08:34:15.392676 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 08:34:15.392676 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: *** Operational MODE: preforking *** Jun 29 08:34:15.392948 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: *** uWSGI is running in multiple interpreter mode *** Jun 29 08:34:15.392948 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: spawned uWSGI master process (pid: 124251) Jun 29 08:34:15.393168 dv-cinder-797608-37-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 08:34:15.393692 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: spawned uWSGI worker 1 (pid: 124265, cores: 1) Jun 29 08:34:15.394274 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: spawned uWSGI worker 2 (pid: 124266, cores: 1) Jun 29 08:34:15.394563 dv-cinder-797608-37-iscsi devstack@n-api.service[124251]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 08:34:16.045465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 08:34:16.046100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 08:34:17.226967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:34:17.226967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: from cryptography.utils import int_from_bytes Jun 29 08:34:17.227734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:34:17.227734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: from cryptography.utils import int_from_bytes Jun 29 08:34:17.279478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:34:17.279478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: from cryptography.utils import int_from_bytes Jun 29 08:34:17.280144 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:34:17.280144 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: from cryptography.utils import int_from_bytes Jun 29 08:34:19.605338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 08:34:19.605994 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 08:34:19.606100 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 08:34:19.606524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 08:34:19.606747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 08:34:19.607145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.607473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.607791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.608113 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.608448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.608758 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.609083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.609403 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.609733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.609999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.610313 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.610640 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-37-iscsi {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.610995 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.611301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.611598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.611918 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.612224 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.612548 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.612853 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.613359 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.613941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.614417 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.614989 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.615357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.615681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.615998 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.616303 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.616620 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.616977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.617261 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.617708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-37-iscsi {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.618034 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.618305 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.618643 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.619088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.619402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.619736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.620050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.620413 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.620707 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.621043 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.621339 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.621660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.621972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.622285 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.622569 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.622927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.623261 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.623559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.623863 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.624115 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.624406 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.624726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.625051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.625407 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.625636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.625898 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.626209 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.626545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.626861 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.627171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.627482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.627798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.628102 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.628395 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.628693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.628997 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.629381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.629708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.630035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.630344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.630667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.631108 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.631362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.632692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.632692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.632692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.632692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.633252 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.633252 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.633531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.634412 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.634412 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.634713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.635945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.635945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.635945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.635945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.635945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.636699 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.636699 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.636995 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.637136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.637889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.637889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.638488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.638488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.638808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.639109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.639257 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.639486 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.639795 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.640095 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.640426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.640753 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.641057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.641367 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.641671 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.641978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.642299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.642607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.642915 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.643437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.643748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.644042 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.644359 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.644667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.645009 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.645385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.645882 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.646324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.646649 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.646991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.647300 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.647606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.648029 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.648202 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.648519 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.648824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.649127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.649427 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.649752 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.650078 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.650390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.650768 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.651028 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.651332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.651673 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.652009 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.652358 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.652700 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.653013 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.653345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.653663 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.653978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.654291 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.654618 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.654972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.655285 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.655598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.655916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.656231 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.656564 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.656881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.657198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.657517 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.657830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.658210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.658473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.658839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.659135 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.659480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.659834 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.660148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.660472 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.660896 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.661211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.661522 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.661835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.662229 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.662497 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.662837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.663159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.663471 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.663780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.664089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.664399 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.664708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.665052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.665366 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.665686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.666047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.666731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.666731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.666966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.667247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.667555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.667869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.668169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.668481 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.668784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.669110 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.669448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.669765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.670109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.670421 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.670789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.671073 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.671383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.671693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.672009 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.672322 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.672709 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.672971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.673277 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.673587 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.673945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.674211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.674521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.674871 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.675186 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.675501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.675813 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.676150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.676489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.676810 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.677128 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.677467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.677846 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.678245 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.678472 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.678816 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.679137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.679444 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.679762 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.680065 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.680372 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.680680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.680993 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.681300 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.681606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.681912 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.682218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.682521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.682878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.683523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.683523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.683795 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.684100 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.684455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.684762 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.685109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.685460 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.685775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.686133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.686426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.686760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.687080 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.687394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.687706 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.688018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.688343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.688658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.688984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.689294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.689621 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.689941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.690264 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.690571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.690914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.691258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.691595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.691972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.692425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.692950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.693277 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.693589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.693902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.694215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.694528 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.694877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.695192 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.695512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.695826 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.696151 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.696465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.696787 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.697117 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.697408 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.697743 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.698078 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.698390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.698711 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.699048 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.699365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.699679 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.699994 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.700302 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.700614 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.700931 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.701250 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.701564 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.701877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.702186 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.702504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.702850 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.703162 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.703473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.703784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.704111 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.704424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.704751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.705079 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.705390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.705698 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.706025 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.706340 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.706648 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.706980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.707289 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.707671 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.708050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.708365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.708777 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.709001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.709319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.709640 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.709855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 08:34:19.710357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.710502 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 08:34:19.710652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.710652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.710979 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 08:34:19.711150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.711346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 08:34:19.711497 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.711646 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 08:34:19.711796 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.711950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.712098 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.712240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.712386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.712534 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.712680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.712840 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.712981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.713128 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.713276 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.713427 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.713674 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.713819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.714967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.715062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.715157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.715426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.715536 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.715614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.715686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.715757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.715757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-37-iscsi {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.715904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.715987 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.716066 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.716139 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.716210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.716399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.716673 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.716774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.716864 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.716951 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.717048 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.717235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.717464 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.717644 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.717802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.717960 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.718113 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.718288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.718444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.718598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.718803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.718972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.719123 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.719272 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.719422 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.719573 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.719723 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.719877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.720028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.720176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.720317 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.720466 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.720624 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.720775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.720961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.721113 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.721254 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.721394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.721545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-37-iscsi {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.721686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.721826 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.721967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.722115 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.722268 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.722417 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.722558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.722727 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.722885 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.723090 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.723256 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.723463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.723616 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.723849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.724005 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.724160 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.724302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.724450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.724591 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.724744 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.724893 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.725049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.725204 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.725357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.725509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.725650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.725791 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.725943 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.726092 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.726233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.726374 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.726520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.726683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.726925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.727069 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.727209 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.727350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.727490 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.727644 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.727784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.727932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.728073 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.728213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.728360 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.728512 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.728669 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.728811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.728955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.729111 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.729324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.729478 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.729619 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.729759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.729907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.730052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.730202 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.730354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.730502 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.730652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.730820 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.730972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.731124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.731265 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.731405 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.731544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.731684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.731824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.731976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.732125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.732286 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.732427 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.732574 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.732729 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.732872 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.733018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.733166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.733314 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.733455 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.733603 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.733745 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.733978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.734136 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.734288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.734435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.734597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.734828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.734984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.735132 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.735284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.735425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.735579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.735720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.735871 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.736021 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.736174 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.736329 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.736470 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.736610 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.736758 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.736905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.737046 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.737194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.737338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.737478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.737658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.737804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.737962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.738134 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.738288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.738459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.738637 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.738816 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.738970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.739121 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.739271 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.739421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.739570 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.739710 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.739710 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.739988 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.740151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.740292 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.740441 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.740582 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.740736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.740901 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.741058 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.741199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.741347 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.741496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.741646 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.741786 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.741926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.742076 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.742224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.742364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.742517 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.742666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.742839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.742989 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.743137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.743292 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.743440 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.743589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.743730 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.743881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.744107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.744269 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.744410 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.744550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.744692 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.744840 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.744991 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.745131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.745280 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.745428 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.745583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.745725 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.745876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.746015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.746015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.746288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.746438 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.746586 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.746785 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.746932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.747137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.747278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.747278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.747556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.747705 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.747857 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.748006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.748154 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.748296 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.748436 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.748577 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.748725 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.748874 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.749024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.749165 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.749313 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.749460 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.749600 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.749758 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.749915 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.750064 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.750212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.750363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.750504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.750651 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.750844 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.750996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.751144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.751292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.751433 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.751587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.751745 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.751895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.752036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.752176 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.752317 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.752466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.752625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.752766 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.752914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.753100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.753241 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.753390 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:34:19.753542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.753690 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.753837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.753978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.754142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.754487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.754676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.754864 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.755006 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.755161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.755317 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.755459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.755599 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.755752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.755892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.756040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.756191 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.756341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.756490 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.756638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.756780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.756928 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.757149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.757302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.757450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.757599 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.757758 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.757908 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.758062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.758212 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.758354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.758494 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.758642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.758856 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.759005 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.759154 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.759295 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.759448 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.759598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.759747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.759888 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.760036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.760183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.760324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.760473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.760623 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.760763 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.760903 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.761050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.761198 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.761338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.761498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.761647 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.761795 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.761942 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.762090 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.762240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.762388 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.762536 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.762724 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.762870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.763028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.763181 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.763323 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.763473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.763622 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.763771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.764007 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.764173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.764322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.764557 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.764714 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.764856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.765006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.765006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.765290 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.765443 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.765585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.765725 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.765878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.766028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.766169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.766318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.766468 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.766609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.766854 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.767002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.767142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.767291 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.767448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.767589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.767746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.767909 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.768057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.768197 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.768345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.768495 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.768645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.768786 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.768935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.769075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.769223 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.769382 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.769525 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.769673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.769815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.769998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.770149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.770303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.770452 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.770601 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.770796 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.770950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.771109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.771266 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.771579 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.771727 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.771883 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.772039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.772197 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.772350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.772498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.772652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.772799 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.772956 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.773104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.773260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.773408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.773554 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.773709 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.773870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.774027 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.774182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.774336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.774482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.774738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.774907 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.775066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.775223 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.775390 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.775544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.775701 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.775848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.775996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.776144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.776300 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.776456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.776612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.776767 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.776921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.777076 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.777225 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.777382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.777541 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.777690 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.777837 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.777985 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.778131 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.778286 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.778443 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.778591 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.778768 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.778920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.779067 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.779233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.779397 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.779545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.779692 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.779839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.779986 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.780147 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.780304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.780458 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.780613 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.780761 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.780916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.781145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.781315 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.781315 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.781606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.781754 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.781903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.782059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.782214 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.782363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.782517 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.782667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.782854 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.783011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.783159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.783323 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.783478 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.783632 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.783789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.783984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.784145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.784301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.784449 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.784605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.784848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.785003 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.785203 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.785353 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.785577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.785742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.785908 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.786065 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.786220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.786376 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.786524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.786524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.786886 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.787043 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.787198 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.787346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.787492 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.787666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.787823 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.787980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.788128 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.788275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.788428 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.788428 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.788731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.788731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.789016 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.789170 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.789325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.789492 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.789648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.789648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.789944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.790099 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.790260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.790407 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.790553 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.790718 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.790870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.791017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.791175 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.791323 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.791487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.791635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.791790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.791938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.792104 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.792254 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.792401 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.792556 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.792712 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.792870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.793036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.793191 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.793338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.793503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.793650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.793804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.793961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.794117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.794271 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.794426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.794573 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.794786 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.795022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.795193 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.795349 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.795497 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.795655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.795811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.795811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.796090 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.796245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.796400 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.796554 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.796715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.796871 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.797018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.797172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.797326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.797491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.797652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.797799 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.797953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.798101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.798262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.798424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.798578 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.798753 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.798913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.799060 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.799216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.799373 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.799531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.799685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.799838 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.799986 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.800132 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.800292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.800440 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.800595 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.800743 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.800897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.801053 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.801234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.801402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.801558 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.801712 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.801859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.801859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.802153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.802305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.802459 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.802606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.802606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.802936 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.803093 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.803258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.803258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.803561 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.803717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.803865 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.804012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.804184 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.804367 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.804647 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.804816 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.804966 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.805215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.805370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.805539 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.805697 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.805859 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.806007 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.806154 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.806308 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.806455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.806612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.806782 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.806934 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.807082 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.807230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.807387 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.807560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.807717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.807872 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.808019 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.808167 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.808314 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.808475 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.808475 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.808778 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.808926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.809071 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.809225 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.809392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.809548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.809696 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.809844 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.809997 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.810229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.810386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.810533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.810680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.810894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.811042 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.811199 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.811347 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.811508 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.811662 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.811811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.811957 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.812114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.812261 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.812408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.812555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.812701 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.812855 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.813017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.813172 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.813327 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.813485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.813639 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.813796 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.813955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.814103 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.814256 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.814403 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.814565 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.814747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.814910 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.814910 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.815216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.815444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.815596 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.815757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.815914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.816070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.816218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.816372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.816526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.816682 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.816896 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.817050 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.817242 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.817403 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.817571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.817727 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.817874 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.818022 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.818182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.818331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.818486 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.818650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.818879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.819036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.819185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.819342 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.819489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.819650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.819811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.819960 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.820114 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.820262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.820409 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.820556 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.820717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.820874 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.821029 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.821185 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.821333 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.821487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.821656 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.821805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.821952 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.822108 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.822263 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.822424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.822579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.822743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.822905 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.823060 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.823213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.823372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.823531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.823686 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.823833 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.823989 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.824136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.824296 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.824453 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.824608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.824755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.824903 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.825050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.825216 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.825368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.825606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.825760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.825916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.826073 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.826229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.826377 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.826649 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.826849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.827011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.827173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.827322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.827470 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.827625 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.827784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.827932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.828092 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.828246 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.828393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.828542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.828688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.828848 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.828996 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.829143 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.829143 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.829420 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.829576 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.829749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.829906 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.830054 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.830200 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.830354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.830501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.830501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.830925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.831082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.831230 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.831377 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.831524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.831694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.831851 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.831998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.832145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.832300 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.832485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.832635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.832790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.832938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.833085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.833232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.833392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.833540 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.833705 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.833861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.834008 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.834155 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.834315 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.834471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.834618 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.834810 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.834971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.834971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.835273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.835423 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.835596 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.835835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.835989 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.836148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.836297 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.836451 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.836599 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.836746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.836901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.837062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.837210 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.837364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.837512 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.837680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.837828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.837985 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.838133 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.838280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.838426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.838580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.838747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.838913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.839061 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.839216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.839363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.839845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.840014 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.840014 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.840304 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.840462 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.840609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.840756 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.840912 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.841060 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.841208 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.841356 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.841503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.841651 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.841817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.841972 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.841972 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.842262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.842419 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.842580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.842784 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.842938 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.843085 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.843242 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.843391 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.843547 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.843703 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.843868 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.844024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.844173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.844320 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.844480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.844635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.844782 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.844938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.845093 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.845264 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.845413 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.845561 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.845715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.845959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.846120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.846282 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.846431 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.846585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.846749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.846913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.847069 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.847226 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.847375 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.847522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.847670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.847827 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.847975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.848274 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.848450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.848600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.848748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.848904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.849063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.849239 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.849389 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.849537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.849684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.849841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.850014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.850170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.850326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.850474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.850622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.850622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.850941 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.851089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.851244 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.851392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.851539 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.851694 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.851851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.852016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.852164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.852312 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.852459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.852608 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.853126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.853287 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.853436 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.853584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.853740 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.853902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.854058 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.854206 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.854365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.854513 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.854668 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.854884 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.855035 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.855189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.855348 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.855348 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.855628 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.855789 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.855963 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.856188 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.856351 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.856499 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.856646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.856807 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.856957 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.857112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.857267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.857421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.857577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.858087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.858252 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.858252 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.858535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.858720 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.858893 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.859050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.859199 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.859354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.859502 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.859649 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.859806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.859962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.860119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.860267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.860413 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.860413 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.860806 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.860968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.861125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.861125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.861408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.861570 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.861720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.861876 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.862024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.862280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.862540 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.862794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.862983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.863142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.863291 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.863447 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.863596 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.863790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.863939 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.864086 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.864243 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.864398 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.864554 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.864702 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.864857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.865023 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.865185 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.865344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.865501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.865501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.865788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.865788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.866077 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.866315 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.866484 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.866633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.866830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.866997 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.867144 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.867307 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.867464 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.867610 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.867765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.867922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.868078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.868078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.868380 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.868380 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.868668 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.868668 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.868961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.868961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869411 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 08:34:19.869559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.869559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.870685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.870685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.870685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.870685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.870685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.870685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.870685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.870685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.871806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.871806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.871806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.871806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.872370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.872526 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.872673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.872990 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.873299 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.873603 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.873908 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.874232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.874536 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.874885 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.875199 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.875522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.875843 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.876150 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.876478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.876788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.877090 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.877395 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.877705 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.878046 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.878349 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.878668 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.879034 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.879458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.879771 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.880104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.880428 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.880746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.881062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.881385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.881689 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.881992 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.882299 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.882599 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.882927 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.883231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.883591 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.883863 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.884134 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.884435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.884757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.885059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.885384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.885693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.885996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.886301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.886607 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.886981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.887288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.887626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.887946 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.888270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.888597 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.889118 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.889281 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.889519 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.889834 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.890148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.890464 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.890800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.891117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.891431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.891742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.892055 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.892369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.892683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.893257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.893583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.893978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.894210 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.894521 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.894856 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.895251 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.895561 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.895871 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.896181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.896490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.896814 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.897137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.897462 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.897801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.898118 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.898509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.898759 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.899074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.899431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.899746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.900054 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.900367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.900683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.900997 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.901308 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.901618 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.901931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.902238 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.902548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.902908 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.903224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.903536 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.903866 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.904200 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.904518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.904831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.905146 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.905776 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.906309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.906626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.906989 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.907318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.907652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.908343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.908343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.908841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.909002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.909194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.909508 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.909815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.910121 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.910442 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.910823 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.911108 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.911429 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.911740 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.912285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.912636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.912956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.913283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.913608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.913962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.914231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.914556 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.914890 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.915199 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.915515 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.915826 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.916131 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.916435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.916746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.917056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.917367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.917676 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.917978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.918305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.918629 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.918981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.919286 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.919598 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.919903 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.920207 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.920511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.920814 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.921127 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.921506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.921733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.922087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.922338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.922640 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.922977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.923324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.923648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.923950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.924252 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.924568 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.924877 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.925201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.925514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.925822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.926276 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.926722 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.927283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.927629 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.927952 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.928289 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.928603 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO dbcounter [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Registered counter for database nova_api Jun 29 08:34:19.928851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.929023 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.929261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.929507 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.929831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.930142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.930452 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.930782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.931137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.931399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.931708 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.932015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.932324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.932631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.932937 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.933330 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.933544 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.933850 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.934232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.934535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.934839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.935157 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.935471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.935784 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.936096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.936406 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.936714 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.937022 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.937341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.937672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.937985 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.938288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.938881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.939164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.939484 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.939803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.940111 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.940432 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.940755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.941063 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.941385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.941693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.942051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.942389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.942741 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.943070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.943376 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.943681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.943984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.944340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.944646 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.944907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.945209 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.945635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.945879 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.946646 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.947101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.947101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.947696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.947696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.948124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.948331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.948562 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.948881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.949204 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.949447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.949837 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.950044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.950349 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.950639 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.950964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.951258 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.951598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_db.sqlalchemy.engines [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:34:19.951797 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.951998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.952227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.952666 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.952897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.953175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.953506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.953804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.954126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.954631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.954939 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.955095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.955403 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.956295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.956295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.956295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.956725 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.956921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.957207 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.957589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.957992 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.958272 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.958600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.958997 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.959275 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.959578 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.959896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.960259 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.960509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.960822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.961131 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.961481 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.961775 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.962052 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.962380 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.962877 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.963048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.963340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.963668 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.964016 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.965028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.965028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.965451 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.965636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.965948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.966581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:34:19.966581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 08:34:19.966945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writer thread running {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:34:20.028653 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO dbcounter [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Registered counter for database nova_api Jun 29 08:34:20.033568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.context [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7545d786-af29-40a6-b32b-77c663f0f8d5(cell1) {{(pid=124265) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 08:34:20.037898 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:34:20.039537 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:34:20.040348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:34:20.042333 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:34:20.044383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO dbcounter [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Registered counter for database nova_cell0 Jun 29 08:34:20.048569 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO dbcounter [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Registered counter for database nova_cell1 Jun 29 08:34:20.048750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_db.sqlalchemy.engines [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:34:20.055781 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writer thread running {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:34:20.056278 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_db.sqlalchemy.engines [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:34:20.058342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_db.sqlalchemy.engines [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:34:20.065636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writer thread running {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:34:20.066999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writer thread running {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:34:20.112025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.context [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7545d786-af29-40a6-b32b-77c663f0f8d5(cell1) {{(pid=124266) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 08:34:20.116542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:34:20.118251 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:34:20.119197 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:34:20.121257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:34:20.123362 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO dbcounter [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Registered counter for database nova_cell0 Jun 29 08:34:20.127519 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO dbcounter [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Registered counter for database nova_cell1 Jun 29 08:34:20.135149 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_db.sqlalchemy.engines [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:34:20.137419 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_db.sqlalchemy.engines [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:34:20.141649 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writer thread running {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:34:20.215355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO dbcounter [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Registered counter for database nova_cell0 Jun 29 08:34:20.222001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_db.sqlalchemy.engines [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:34:20.227051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writer thread running {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:34:20.280186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writer thread running {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:34:20.291104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO dbcounter [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Registered counter for database nova_cell0 Jun 29 08:34:20.298179 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_db.sqlalchemy.engines [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:34:20.303315 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writer thread running {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:34:20.543270 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: WARNING keystonemiddleware.auth_token [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:34:20.550493 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: WARNING keystonemiddleware.auth_token [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:34:20.615870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: WARNING keystonemiddleware.auth_token [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:34:20.623316 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: WARNING keystonemiddleware.auth_token [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:34:20.892426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: WARNING keystonemiddleware.auth_token [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:34:20.898962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: WARNING keystonemiddleware.auth_token [None req-36925aa3-735d-4f08-b1ee-50d3748b3f84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:34:20.904602 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b0bea579c0 pid: 124265 (default app) Jun 29 08:34:20.968131 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: WARNING keystonemiddleware.auth_token [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:34:20.974239 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: WARNING keystonemiddleware.auth_token [None req-1aa7df49-04dc-499c-97c0-547873ebbe9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:34:20.979683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b0bea579c0 pid: 124266 (default app) Jun 29 08:35:01.863716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:01.865238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:01.867035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:01.868258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:03.159898 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b14bc7ce-81a2-4ea3-8ee4-c019370e941d tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Action: 'create', calling method: .version_select at 0x7fade508a3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-952956993", "metadata": {"Type": "work"}}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:06.071989 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b14bc7ce-81a2-4ea3-8ee4-c019370e941d tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.229462 Jun 29 08:35:06.072627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1155 bytes} [Wed Jun 29 08:35:01 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4232 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 08:35:06.656554 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-70bae00e-f6ca-42f2-9982-99bd038c2293 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Calling method '.version_select at 0x7fade513d4c0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:06.694683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:06.696261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:06.698209 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:06.699172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:07.314443 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-70bae00e-f6ca-42f2-9982-99bd038c2293 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf" status: 200 len: 352 microversion: 2.1 time: 1.232600 Jun 29 08:35:07.315707 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:35:06 2022] GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf => generated 352 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:08.329808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f778b915-24d6-4537-bb64-e5ffd10728c0 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Calling method '.version_select at 0x7fade4f60280>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:08.448611 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f778b915-24d6-4537-bb64-e5ffd10728c0 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf" status: 200 len: 353 microversion: 2.1 time: 0.123058 Jun 29 08:35:08.458089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:35:08 2022] GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:08.469099 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d03e80ba-4508-4b4d-8b6a-2aa143ba74fb tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Calling method '.version_select at 0x7fade4f53310>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:08.647342 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d03e80ba-4508-4b4d-8b6a-2aa143ba74fb tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf" status: 200 len: 353 microversion: 2.1 time: 0.144606 Jun 29 08:35:08.647342 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:35:08 2022] GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:08.647786 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-46f12a14-12dc-4d5f-a940-2743527d6f75 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Calling method '.version_select at 0x7fade4f60550>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:08.813182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-46f12a14-12dc-4d5f-a940-2743527d6f75 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf" status: 202 len: 0 microversion: 2.1 time: 0.187968 Jun 29 08:35:08.814044 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:35:08 2022] DELETE /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:35:08.824388 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0efe005c-6e95-4f4e-b391-ab234f6ad4ed tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Calling method '.version_select at 0x7fade4f534c0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:08.945679 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0efe005c-6e95-4f4e-b391-ab234f6ad4ed tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf" status: 200 len: 352 microversion: 2.1 time: 0.125596 Jun 29 08:35:08.947268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:35:08 2022] GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:09.959941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-34b864f6-046e-4b67-af85-8cc737c606d8 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Calling method '.version_select at 0x7fade4f60a60>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:10.021845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-34b864f6-046e-4b67-af85-8cc737c606d8 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] HTTP exception thrown: Volume e4f74261-0b48-452e-b61d-273ca07dfcbf could not be found. Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-34b864f6-046e-4b67-af85-8cc737c606d8 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Request method failure captured: Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf HTTP/1.1 Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA61Q6Mn02AElJCH9cF5QLqQOn1G0zsUCJ2IfZyiiPCwY-TITz7c_WeD3YIyd92p5n_H1pmmCvJOE9EyTIhVZUD9dajZDcH1P2jiyqqzNRth069icikqu0Vb5xaRNlhAgtV3hsRMGAFXmHB3YLNaxB2o7NUnmM986VHssfo0pu1hnzQ Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 4e1c22413fe7410ab520a8891c1e0f65 Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-VolumesGetTestJSON-1888004700 Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:35:10.028382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4e1c22413fe7410ab520a8891c1e0f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e1c22413fe7410ab520a8891c1e0f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e1c22413fe7410ab520a8891c1e0f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4e1c22413fe7410ab520a8891c1e0f65"}]}] Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-VolumesGetTestJSON-1888004700 Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 4e1c22413fe7410ab520a8891c1e0f65 Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-VolumesGetTestJSON-1888004700 Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-VolumesGetTestJSON-1888004700-project Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 370e9262843b4ba7a907886fd6e08ac5 Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-VolumesGetTestJSON-1888004700-project Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Volume e4f74261-0b48-452e-b61d-273ca07dfcbf could not be found. Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'e4f74261-0b48-452e-b61d-273ca07dfcbf'} Jun 29 08:35:10.029435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4f74261-0b48-452e-b61d-273ca07dfcbf could not be found. (HTTP 404) (Request-ID: req-f31f1704-b8df-4067-a240-efae8693023c) Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:35:10.030036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:35:10.030890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4f74261-0b48-452e-b61d-273ca07dfcbf could not be found. Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 08:35:10.031748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4f74261-0b48-452e-b61d-273ca07dfcbf could not be found. Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4f74261-0b48-452e-b61d-273ca07dfcbf could not be found. Jun 29 08:35:10.032580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:35:10.035742 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-34b864f6-046e-4b67-af85-8cc737c606d8 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] Returning 404 to user: Volume e4f74261-0b48-452e-b61d-273ca07dfcbf could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:35:10.036802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-34b864f6-046e-4b67-af85-8cc737c606d8 tempest-VolumesGetTestJSON-1888004700 tempest-VolumesGetTestJSON-1888004700-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf" status: 404 len: 109 microversion: 2.1 time: 0.081516 Jun 29 08:35:10.042246 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:35:09 2022] GET /compute/v2.1/os-volumes/e4f74261-0b48-452e-b61d-273ca07dfcbf => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:35:16.288031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5e0bbc67-dbe7-4000-b48d-0fc15175f1d5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: .version_select at 0x7fade4f539d0>, body: {"keypair": {"name": "tempest-keypair-197090399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPfz2bCNIcW2wR5NtFS/odjhP+yjObYTQPCcPaL34w7BiR+8v5TRWXlFFFJ9rIKubdfCAWMkc74S6K2kK07Uuth+UsV2ZAio5VvkQhP5zJTXnPZsa+X7x1CXuJOwvVleA=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:16.552831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-5e0bbc67-dbe7-4000-b48d-0fc15175f1d5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:35:16.576086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-5e0bbc67-dbe7-4000-b48d-0fc15175f1d5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for user bccf002d9da34d1dad0ee71b5b7bb1c1 and project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:35:16.705694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5e0bbc67-dbe7-4000-b48d-0fc15175f1d5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.037072 Jun 29 08:35:16.716330 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 4/8] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:35:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:16.816829 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1764131574", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "networks": [{"uuid": "bb2823a3-2481-472e-884e-4d46d4643197"}]}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:17.031211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] validate_networks() for [('bb2823a3-2481-472e-884e-4d46d4643197', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:35:18.556887 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2139083437", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:18.795389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] validate_networks() for [('7723dae1-92ba-46d4-a07d-34a93508cbcb', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:35:20.223812 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:35:20.224293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:35:20.224872 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:35:20.225409 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:35:20.225944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:35:20.270418 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:20.271878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:20.273169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:20.275915 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:20.368584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Getting quotas for project ed50fef9e1824a2c918d9649f226364d. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:35:20.385501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Getting quotas for user d55c898180bd4cbf910f3d92045e7d67 and project ed50fef9e1824a2c918d9649f226364d. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:35:20.417946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:35:20.426035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:35:20.607050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ff73c485-ce7d-465b-b2b6-96b61b800e5e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.738403 Jun 29 08:35:20.608316 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 5/9] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:35:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 08:35:20.620677 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-985aaeb5-6c0c-4b3f-914a-09b6fc44a135 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:20.621907 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-985aaeb5-6c0c-4b3f-914a-09b6fc44a135 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:20.825415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-985aaeb5-6c0c-4b3f-914a-09b6fc44a135 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:20.861501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-985aaeb5-6c0c-4b3f-914a-09b6fc44a135 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1215 microversion: 2.1 time: 0.243989 Jun 29 08:35:20.868041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 6/10] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:20 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:21.151609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:35:21.152143 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:35:21.152536 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:35:21.152916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:35:21.153325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:35:21.173697 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:21.174173 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:21.178642 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:21.179162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:21.241146 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Getting quotas for project 96872c14d1224c92b3247285f03bb966. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:35:21.252785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Getting quotas for user ac984d1f6efa403e85483bd7fa78000e and project 96872c14d1224c92b3247285f03bb966. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:35:21.277643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:35:21.283785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:35:21.474887 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-23d513a2-172e-4174-9e7e-35c8ebb7e141 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.334939 Jun 29 08:35:21.476191 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 5/11] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:35:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 08:35:21.491364 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7f342f37-5eb5-43e9-becd-c58f5a9e6a0a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:21.492014 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7f342f37-5eb5-43e9-becd-c58f5a9e6a0a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:21.802683 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d6021bac-d249-41a5-934c-12afed0c9bcd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'create', calling method: .version_select at 0x7fade45e0e50>, body: {"keypair": {"name": "tempest-keypair-1853778363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI95ZrUMUYuEtOgSMNSuXpVpk592CkzBvU1lQpXWCxkVSRCjpJ7vTT+Aj20X5B4glZjY2GAaDx7wTUaWcnk/4r3KNzJkauR/pIJa0/1kha0kgGcRhf9PzD47xYa3d4+2Wg=="}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:21.851954 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7f342f37-5eb5-43e9-becd-c58f5a9e6a0a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:21.893757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7f342f37-5eb5-43e9-becd-c58f5a9e6a0a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1222 microversion: 2.1 time: 0.411078 Jun 29 08:35:21.909824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-d6021bac-d249-41a5-934c-12afed0c9bcd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Getting quotas for project c3addc279ffb4a49b379a938b1fbed3c. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:35:21.917193 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:21 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1222 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:21.934063 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-386db8d5-1b9e-45c8-9c85-c7e024b12263 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:21.938956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-386db8d5-1b9e-45c8-9c85-c7e024b12263 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:21.959377 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-d6021bac-d249-41a5-934c-12afed0c9bcd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Getting quotas for user 37d6c5d1f76445499566472213f13e3a and project c3addc279ffb4a49b379a938b1fbed3c. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:35:22.092072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d6021bac-d249-41a5-934c-12afed0c9bcd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.968991 Jun 29 08:35:22.093079 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 7/13] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Jun 29 08:35:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 971 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 08:35:22.130847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-386db8d5-1b9e-45c8-9c85-c7e024b12263 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:22.190097 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-386db8d5-1b9e-45c8-9c85-c7e024b12263 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1215 microversion: 2.1 time: 0.267880 Jun 29 08:35:22.193847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:21 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:22.339350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-659141810", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:22.460632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] validate_networks() for [('7723dae1-92ba-46d4-a07d-34a93508cbcb', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:35:23.213356 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c7799b46-7531-4001-8191-64eac6d66b63 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:23.214043 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c7799b46-7531-4001-8191-64eac6d66b63 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:23.227822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7799b46-7531-4001-8191-64eac6d66b63 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:23.228324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7799b46-7531-4001-8191-64eac6d66b63 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:23.229163 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7799b46-7531-4001-8191-64eac6d66b63 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:23.231471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7799b46-7531-4001-8191-64eac6d66b63 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:23.834040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c7799b46-7531-4001-8191-64eac6d66b63 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:23.866884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c7799b46-7531-4001-8191-64eac6d66b63 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1219 microversion: 2.1 time: 0.655423 Jun 29 08:35:23.867533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:23 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1219 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:24.842943 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:35:24.844831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:35:24.845607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:35:24.846307 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:35:24.850381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:35:24.873162 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:24.874034 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:24.875546 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:24.876709 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:24.884765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-53daef8c-c5f3-4304-8293-69126f43c4db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:24.885386 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-53daef8c-c5f3-4304-8293-69126f43c4db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:24.900717 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53daef8c-c5f3-4304-8293-69126f43c4db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:24.901177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53daef8c-c5f3-4304-8293-69126f43c4db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:24.901961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53daef8c-c5f3-4304-8293-69126f43c4db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:24.902394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53daef8c-c5f3-4304-8293-69126f43c4db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:24.924670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Getting quotas for project 96872c14d1224c92b3247285f03bb966. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:35:24.932149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Getting quotas for user ac984d1f6efa403e85483bd7fa78000e and project 96872c14d1224c92b3247285f03bb966. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:35:24.953605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:35:24.958299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:35:25.119822 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9560796c-6dbf-4d96-abec-998291600e82 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.785994 Jun 29 08:35:25.124981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 8/16] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:35:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:35:25.150846 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bead307c-3cf3-4553-8f6e-560f6c6f4a2e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:25.154983 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bead307c-3cf3-4553-8f6e-560f6c6f4a2e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:25.157210 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-53daef8c-c5f3-4304-8293-69126f43c4db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:25.170876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-53daef8c-c5f3-4304-8293-69126f43c4db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1219 microversion: 2.1 time: 0.286022 Jun 29 08:35:25.175343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 9/17] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:24 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1219 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:25.250932 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bead307c-3cf3-4553-8f6e-560f6c6f4a2e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:25.265347 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bead307c-3cf3-4553-8f6e-560f6c6f4a2e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1221 microversion: 2.1 time: 0.131300 Jun 29 08:35:25.279492 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 9/18] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:25 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:25.281281 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-394274419", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fbe4e8a-ed08-40e1-b1bc-8913ebef6d94"}], "security_groups": [{"name": "tempest-securitygroup--1220181572"}], "key_name": "tempest-keypair-197090399", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:25.558888 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] validate_networks() for [('7fbe4e8a-ed08-40e1-b1bc-8913ebef6d94', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:35:26.198478 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-39cb3352-6ae4-46a6-a8ba-4e3d75837bbb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:26.200524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-39cb3352-6ae4-46a6-a8ba-4e3d75837bbb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:26.221827 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39cb3352-6ae4-46a6-a8ba-4e3d75837bbb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:26.223205 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39cb3352-6ae4-46a6-a8ba-4e3d75837bbb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:26.225581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39cb3352-6ae4-46a6-a8ba-4e3d75837bbb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:26.226462 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39cb3352-6ae4-46a6-a8ba-4e3d75837bbb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:26.370454 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:35:26.371610 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:35:26.372226 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:35:26.373033 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:35:26.373620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:35:26.386657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:26.387309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:26.388342 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:26.388985 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:26.422054 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:35:26.429513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for user bccf002d9da34d1dad0ee71b5b7bb1c1 and project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:35:26.482562 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:35:26.488644 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:35:26.685273 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-39cb3352-6ae4-46a6-a8ba-4e3d75837bbb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:26.688276 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e19a21a9-e1ec-45f9-9e2f-0c15368b9c96 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.412898 Jun 29 08:35:26.690052 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 10/19] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:35:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:35:26.708154 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6693453c-d98c-4d81-839f-a7dc0b6583fb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:26.709516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6693453c-d98c-4d81-839f-a7dc0b6583fb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:26.732446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6693453c-d98c-4d81-839f-a7dc0b6583fb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:26.732879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-39cb3352-6ae4-46a6-a8ba-4e3d75837bbb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1219 microversion: 2.1 time: 0.542185 Jun 29 08:35:26.733033 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6693453c-d98c-4d81-839f-a7dc0b6583fb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:26.733790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6693453c-d98c-4d81-839f-a7dc0b6583fb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:26.735523 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6693453c-d98c-4d81-839f-a7dc0b6583fb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:26.735912 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 10/20] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:26 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1219 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:26.771886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2118517996", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a66168-0837-4bad-a2b8-8a5ff845378e"}], "security_groups": [{"name": "tempest-securitygroup--1761465071"}], "key_name": "tempest-keypair-1853778363", "user_data": "}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:26.878717 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6693453c-d98c-4d81-839f-a7dc0b6583fb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:26.888500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6693453c-d98c-4d81-839f-a7dc0b6583fb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1225 microversion: 2.1 time: 0.196925 Jun 29 08:35:26.897630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 11/21] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:26 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:26.920256 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c5aba15b-f65a-4012-a72f-c1cfb38a5849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:26.949865 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c5aba15b-f65a-4012-a72f-c1cfb38a5849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:27.082462 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c5aba15b-f65a-4012-a72f-c1cfb38a5849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:27.092490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c5aba15b-f65a-4012-a72f-c1cfb38a5849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1240 microversion: 2.1 time: 0.190838 Jun 29 08:35:27.095088 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 12/22] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:26 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1240 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:27.220341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] validate_networks() for [('36a66168-0837-4bad-a2b8-8a5ff845378e', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:35:27.753171 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e1a38fb7-0ab7-4797-98bd-a8a348e014db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:27.754002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e1a38fb7-0ab7-4797-98bd-a8a348e014db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:27.770074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1a38fb7-0ab7-4797-98bd-a8a348e014db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:27.770573 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1a38fb7-0ab7-4797-98bd-a8a348e014db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:27.774164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1a38fb7-0ab7-4797-98bd-a8a348e014db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:27.775736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1a38fb7-0ab7-4797-98bd-a8a348e014db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:27.993653 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e1a38fb7-0ab7-4797-98bd-a8a348e014db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:28.022200 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e1a38fb7-0ab7-4797-98bd-a8a348e014db tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1267 microversion: 2.1 time: 0.271404 Jun 29 08:35:28.032828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 13/23] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:27 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:28.044772 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c151cfba-e12f-45fa-85ab-1a6e8109301a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:28.046164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c151cfba-e12f-45fa-85ab-1a6e8109301a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:28.073601 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c151cfba-e12f-45fa-85ab-1a6e8109301a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:28.079148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c151cfba-e12f-45fa-85ab-1a6e8109301a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:28.083678 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c151cfba-e12f-45fa-85ab-1a6e8109301a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:28.085623 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c151cfba-e12f-45fa-85ab-1a6e8109301a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:28.522146 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c151cfba-e12f-45fa-85ab-1a6e8109301a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:28.533670 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c151cfba-e12f-45fa-85ab-1a6e8109301a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1273 microversion: 2.1 time: 0.506874 Jun 29 08:35:28.534375 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 14/24] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:28 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1273 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:28.564514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7bfa1c7a-8da5-48de-b6e8-6c1cbbd0833c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:28.568293 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7bfa1c7a-8da5-48de-b6e8-6c1cbbd0833c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:28.569839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:35:28.570943 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:35:28.571784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:35:28.572718 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:35:28.573324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:35:28.590368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:28.591955 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:28.593620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7bfa1c7a-8da5-48de-b6e8-6c1cbbd0833c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:28.594310 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7bfa1c7a-8da5-48de-b6e8-6c1cbbd0833c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:28.595255 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:28.596325 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:28.599943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7bfa1c7a-8da5-48de-b6e8-6c1cbbd0833c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:28.600700 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7bfa1c7a-8da5-48de-b6e8-6c1cbbd0833c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:28.721903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Getting quotas for project c3addc279ffb4a49b379a938b1fbed3c. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:35:28.738645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Getting quotas for user 37d6c5d1f76445499566472213f13e3a and project c3addc279ffb4a49b379a938b1fbed3c. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:35:28.773729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7bfa1c7a-8da5-48de-b6e8-6c1cbbd0833c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:28.777345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:35:28.780563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:35:28.786166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7bfa1c7a-8da5-48de-b6e8-6c1cbbd0833c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1236 microversion: 2.1 time: 0.243655 Jun 29 08:35:28.788322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 15/25] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:28 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1236 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:28.968828 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a58ec8d6-b839-404f-8749-65773a097170 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.230026 Jun 29 08:35:28.970918 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 11/26] 10.222.0.27 () {62 vars in 1187 bytes} [Wed Jun 29 08:35:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 29 08:35:28.981075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d8eb0b69-398b-4490-b5b4-e892bcb2c5d2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:28.981962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d8eb0b69-398b-4490-b5b4-e892bcb2c5d2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:29.040157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ddc034ea-3985-4be6-86f5-3e615e76928f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:29.041143 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ddc034ea-3985-4be6-86f5-3e615e76928f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:29.077388 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ddc034ea-3985-4be6-86f5-3e615e76928f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:29.078620 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ddc034ea-3985-4be6-86f5-3e615e76928f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:29.080233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ddc034ea-3985-4be6-86f5-3e615e76928f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:29.082044 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ddc034ea-3985-4be6-86f5-3e615e76928f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:29.149514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d8eb0b69-398b-4490-b5b4-e892bcb2c5d2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:29.167996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d8eb0b69-398b-4490-b5b4-e892bcb2c5d2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:29.172858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d8eb0b69-398b-4490-b5b4-e892bcb2c5d2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:29.177220 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d8eb0b69-398b-4490-b5b4-e892bcb2c5d2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1282 microversion: 2.20 time: 0.197582 Jun 29 08:35:29.180522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 16/27] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:28 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:29.296687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ddc034ea-3985-4be6-86f5-3e615e76928f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:29.332042 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ddc034ea-3985-4be6-86f5-3e615e76928f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1273 microversion: 2.1 time: 0.296106 Jun 29 08:35:29.339991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 12/28] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:29 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:29.553228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-12c19a9f-08e4-4ca0-a672-89b1e10a21ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:29.559028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-12c19a9f-08e4-4ca0-a672-89b1e10a21ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:29.583323 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-12c19a9f-08e4-4ca0-a672-89b1e10a21ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:29.584282 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-12c19a9f-08e4-4ca0-a672-89b1e10a21ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:29.585497 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-12c19a9f-08e4-4ca0-a672-89b1e10a21ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:29.594162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-12c19a9f-08e4-4ca0-a672-89b1e10a21ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:29.795169 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-12c19a9f-08e4-4ca0-a672-89b1e10a21ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:29.806675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-32973249-e636-4d2f-aa9c-f4fa3e6ef4e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:29.810248 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-32973249-e636-4d2f-aa9c-f4fa3e6ef4e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:29.838996 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32973249-e636-4d2f-aa9c-f4fa3e6ef4e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:29.839914 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-12c19a9f-08e4-4ca0-a672-89b1e10a21ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1279 microversion: 2.1 time: 0.282289 Jun 29 08:35:29.840831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 17/29] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:29 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1279 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:29.842546 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32973249-e636-4d2f-aa9c-f4fa3e6ef4e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:29.848164 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32973249-e636-4d2f-aa9c-f4fa3e6ef4e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:29.853078 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32973249-e636-4d2f-aa9c-f4fa3e6ef4e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:30.200752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:30.201693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:30.212612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:30.213071 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:30.213888 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:30.214314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:30.220874 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-32973249-e636-4d2f-aa9c-f4fa3e6ef4e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:30.270627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-32973249-e636-4d2f-aa9c-f4fa3e6ef4e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1298 microversion: 2.1 time: 0.468634 Jun 29 08:35:30.277040 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 13/30] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:29 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1298 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:30.360060 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5f99e74c-8ed0-4bfb-ab93-279f4793c42a tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:30.361175 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5f99e74c-8ed0-4bfb-ab93-279f4793c42a tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:30.375045 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5f99e74c-8ed0-4bfb-ab93-279f4793c42a tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:30.375901 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5f99e74c-8ed0-4bfb-ab93-279f4793c42a tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:30.376932 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5f99e74c-8ed0-4bfb-ab93-279f4793c42a tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:30.378686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5f99e74c-8ed0-4bfb-ab93-279f4793c42a tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:30.408835 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:30.433533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:30.435116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:30.436243 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0b9be876-09a1-4364-bf52-def657f5c774 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1286 microversion: 2.20 time: 0.240199 Jun 29 08:35:30.448533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 18/31] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:30 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:35:30.735485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5f99e74c-8ed0-4bfb-ab93-279f4793c42a tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:30.759035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5f99e74c-8ed0-4bfb-ab93-279f4793c42a tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1273 microversion: 2.1 time: 0.398552 Jun 29 08:35:30.770555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 14/32] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:30 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1273 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:30.858633 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fc74f65b-5666-4ab7-a430-e3427f1e0add tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:30.859878 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fc74f65b-5666-4ab7-a430-e3427f1e0add tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:30.881091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc74f65b-5666-4ab7-a430-e3427f1e0add tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:30.881694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc74f65b-5666-4ab7-a430-e3427f1e0add tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:30.882551 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc74f65b-5666-4ab7-a430-e3427f1e0add tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:30.883050 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc74f65b-5666-4ab7-a430-e3427f1e0add tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:31.293292 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7ec16486-fb62-4efe-bd90-5006a79915c9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:31.294626 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7ec16486-fb62-4efe-bd90-5006a79915c9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:31.314110 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7ec16486-fb62-4efe-bd90-5006a79915c9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:31.314778 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7ec16486-fb62-4efe-bd90-5006a79915c9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:31.317789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7ec16486-fb62-4efe-bd90-5006a79915c9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:31.318976 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7ec16486-fb62-4efe-bd90-5006a79915c9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:31.543705 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7ec16486-fb62-4efe-bd90-5006a79915c9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:31.556038 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7ec16486-fb62-4efe-bd90-5006a79915c9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1298 microversion: 2.1 time: 0.266467 Jun 29 08:35:31.556632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 15/33] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:31 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1298 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:35:31.573997 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:31.574628 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:31.604622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:31.604981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:31.605754 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:31.606183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:31.920241 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:31.944841 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:31.946798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:31.969005 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4c4a450f-80da-4f06-a93e-529a7c8f2316 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.389191 Jun 29 08:35:31.970760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 16/34] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:31 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:31.977221 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b46248a9-525d-467a-b193-0b0f75ec8ce0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:31.978165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b46248a9-525d-467a-b193-0b0f75ec8ce0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:31.987925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b46248a9-525d-467a-b193-0b0f75ec8ce0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:31.989024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b46248a9-525d-467a-b193-0b0f75ec8ce0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:31.990159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b46248a9-525d-467a-b193-0b0f75ec8ce0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:31.990865 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b46248a9-525d-467a-b193-0b0f75ec8ce0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:32.185918 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fc74f65b-5666-4ab7-a430-e3427f1e0add tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:32.194842 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fc74f65b-5666-4ab7-a430-e3427f1e0add tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 1.340735 Jun 29 08:35:32.198875 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 19/35] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:30 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:32.221974 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b46248a9-525d-467a-b193-0b0f75ec8ce0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:32.237648 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b46248a9-525d-467a-b193-0b0f75ec8ce0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1273 microversion: 2.1 time: 0.264698 Jun 29 08:35:32.243529 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 17/36] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:31 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:32.576456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d8d436af-52d1-41cb-915e-d13dba946e79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:32.577067 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d8d436af-52d1-41cb-915e-d13dba946e79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:32.584356 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8d436af-52d1-41cb-915e-d13dba946e79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:32.584944 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8d436af-52d1-41cb-915e-d13dba946e79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:32.585705 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8d436af-52d1-41cb-915e-d13dba946e79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:32.586181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8d436af-52d1-41cb-915e-d13dba946e79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:32.703418 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d8d436af-52d1-41cb-915e-d13dba946e79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:32.717167 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d8d436af-52d1-41cb-915e-d13dba946e79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1298 microversion: 2.1 time: 0.144515 Jun 29 08:35:32.727340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 20/37] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:32 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:32.999246 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:33.000322 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:33.013900 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:33.014507 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:33.015856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:33.016292 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:33.163577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:33.177403 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:33.179852 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:33.181240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e845dace-deef-4fe6-8172-2fa45f35b0e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.192289 Jun 29 08:35:33.182404 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 18/38] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:32 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:33.216269 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7816baf0-b47c-43f2-8b72-0ad19157a4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:33.216964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7816baf0-b47c-43f2-8b72-0ad19157a4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:33.225794 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7816baf0-b47c-43f2-8b72-0ad19157a4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:33.226321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7816baf0-b47c-43f2-8b72-0ad19157a4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:33.227250 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7816baf0-b47c-43f2-8b72-0ad19157a4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:33.227783 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7816baf0-b47c-43f2-8b72-0ad19157a4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:33.259445 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5eb8cf14-5588-448a-9b6b-fa22505e6e04 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:33.260813 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5eb8cf14-5588-448a-9b6b-fa22505e6e04 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:33.275346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5eb8cf14-5588-448a-9b6b-fa22505e6e04 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:33.276032 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5eb8cf14-5588-448a-9b6b-fa22505e6e04 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:33.277795 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5eb8cf14-5588-448a-9b6b-fa22505e6e04 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:33.279089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5eb8cf14-5588-448a-9b6b-fa22505e6e04 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:33.503988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7816baf0-b47c-43f2-8b72-0ad19157a4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:33.511000 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5eb8cf14-5588-448a-9b6b-fa22505e6e04 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:33.521041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5eb8cf14-5588-448a-9b6b-fa22505e6e04 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.267616 Jun 29 08:35:33.522503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 19/39] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:33 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:35:33.526537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7816baf0-b47c-43f2-8b72-0ad19157a4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.304919 Jun 29 08:35:33.528811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:33 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:33.733393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dae3c57a-c607-422a-a1e4-9378d94cd019 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:33.734004 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-dae3c57a-c607-422a-a1e4-9378d94cd019 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:33.740239 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dae3c57a-c607-422a-a1e4-9378d94cd019 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:33.740678 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dae3c57a-c607-422a-a1e4-9378d94cd019 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:33.741438 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dae3c57a-c607-422a-a1e4-9378d94cd019 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:33.741866 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dae3c57a-c607-422a-a1e4-9378d94cd019 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:33.894139 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dae3c57a-c607-422a-a1e4-9378d94cd019 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:33.905817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dae3c57a-c607-422a-a1e4-9378d94cd019 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.176258 Jun 29 08:35:33.907039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 20/41] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:33 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:34.206653 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:34.207280 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:34.213659 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:34.214102 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:34.215228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:34.216003 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:34.296329 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:34.304816 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:34.306368 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:34.307480 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-508fd348-77ef-4735-bf58-2764b9d1ecec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.105284 Jun 29 08:35:34.308008 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:34 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:35:34.538240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1dad1082-2b4e-4133-acc5-bdfda8487754 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:34.538899 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1dad1082-2b4e-4133-acc5-bdfda8487754 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:34.545789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1dad1082-2b4e-4133-acc5-bdfda8487754 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:34.546260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1dad1082-2b4e-4133-acc5-bdfda8487754 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:34.546964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5890041d-955e-4b0a-8a6f-2956e98058f9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:34.547185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1dad1082-2b4e-4133-acc5-bdfda8487754 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:34.547468 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1dad1082-2b4e-4133-acc5-bdfda8487754 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:34.547768 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5890041d-955e-4b0a-8a6f-2956e98058f9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:34.554173 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5890041d-955e-4b0a-8a6f-2956e98058f9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:34.554959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5890041d-955e-4b0a-8a6f-2956e98058f9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:34.556033 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5890041d-955e-4b0a-8a6f-2956e98058f9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:34.556560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5890041d-955e-4b0a-8a6f-2956e98058f9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:34.806378 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5890041d-955e-4b0a-8a6f-2956e98058f9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:34.812445 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1dad1082-2b4e-4133-acc5-bdfda8487754 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:34.814121 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5890041d-955e-4b0a-8a6f-2956e98058f9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.271493 Jun 29 08:35:34.815079 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:34 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:34.822557 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1dad1082-2b4e-4133-acc5-bdfda8487754 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.288823 Jun 29 08:35:34.823534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 21/44] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:34 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:34.926462 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec8e4b6f-7f66-4162-b865-189e0db1eff9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:34.927453 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec8e4b6f-7f66-4162-b865-189e0db1eff9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:34.935105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec8e4b6f-7f66-4162-b865-189e0db1eff9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:34.939263 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec8e4b6f-7f66-4162-b865-189e0db1eff9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:34.940541 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec8e4b6f-7f66-4162-b865-189e0db1eff9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:34.941480 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec8e4b6f-7f66-4162-b865-189e0db1eff9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:35.148187 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec8e4b6f-7f66-4162-b865-189e0db1eff9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:35.160939 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec8e4b6f-7f66-4162-b865-189e0db1eff9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.240778 Jun 29 08:35:35.162241 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 24/45] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:34 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:35.325633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:35.326379 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:35.338771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:35.339212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:35.340334 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:35.340773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:35.409967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:35.423400 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:35.425128 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:35.427779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-194d2394-b117-49e6-bbc5-f71fe97c8b0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.106198 Jun 29 08:35:35.428543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:35 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:35.831420 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0134c6e9-d041-4c93-9ba1-d8b3a3d2dd8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:35.832662 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0134c6e9-d041-4c93-9ba1-d8b3a3d2dd8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:35.840620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0134c6e9-d041-4c93-9ba1-d8b3a3d2dd8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:35.841365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0134c6e9-d041-4c93-9ba1-d8b3a3d2dd8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:35.843541 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0134c6e9-d041-4c93-9ba1-d8b3a3d2dd8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:35.843969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0134c6e9-d041-4c93-9ba1-d8b3a3d2dd8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:35.846524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a0c91046-3410-4d71-bc29-34e8b3eb3ae0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:35.848688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a0c91046-3410-4d71-bc29-34e8b3eb3ae0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:35.855421 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a0c91046-3410-4d71-bc29-34e8b3eb3ae0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:35.855889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a0c91046-3410-4d71-bc29-34e8b3eb3ae0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:35.856679 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a0c91046-3410-4d71-bc29-34e8b3eb3ae0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:35.857117 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a0c91046-3410-4d71-bc29-34e8b3eb3ae0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:36.089294 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0134c6e9-d041-4c93-9ba1-d8b3a3d2dd8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:36.099372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0134c6e9-d041-4c93-9ba1-d8b3a3d2dd8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.272295 Jun 29 08:35:36.103062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 25/47] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:35 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:36.116949 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a0c91046-3410-4d71-bc29-34e8b3eb3ae0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:36.130296 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a0c91046-3410-4d71-bc29-34e8b3eb3ae0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.294275 Jun 29 08:35:36.131368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:35 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:36.185231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9708f300-2131-47ca-8ac9-20ab13eeb987 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:36.185930 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9708f300-2131-47ca-8ac9-20ab13eeb987 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:36.194931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9708f300-2131-47ca-8ac9-20ab13eeb987 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:36.195581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9708f300-2131-47ca-8ac9-20ab13eeb987 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:36.196808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9708f300-2131-47ca-8ac9-20ab13eeb987 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:36.197387 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9708f300-2131-47ca-8ac9-20ab13eeb987 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:36.360906 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9708f300-2131-47ca-8ac9-20ab13eeb987 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:36.364560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:36.373428 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9708f300-2131-47ca-8ac9-20ab13eeb987 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.199167 Jun 29 08:35:36.374368 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 26/49] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:36 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:36.446256 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:36.446884 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:36.453159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:36.453598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:36.454363 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:36.463413 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:36.537955 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:36.546344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:36.547922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:36.549086 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-14ed71da-b731-4c0f-a0d0-ebc99bfd591c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.107298 Jun 29 08:35:36.549862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 24/50] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:36 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:37.122982 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a02508b4-d5d2-4cca-96b7-f786a6d996eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:37.124229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a02508b4-d5d2-4cca-96b7-f786a6d996eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:37.131263 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=4 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:37.144502 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:37.148686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9c9b69ae-0c61-4f67-b333-a343b59aaf21 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:37.149804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9c9b69ae-0c61-4f67-b333-a343b59aaf21 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:37.163066 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:37.164837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9c9b69ae-0c61-4f67-b333-a343b59aaf21 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:37.165386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9c9b69ae-0c61-4f67-b333-a343b59aaf21 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:37.165900 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a02508b4-d5d2-4cca-96b7-f786a6d996eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:37.166670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9c9b69ae-0c61-4f67-b333-a343b59aaf21 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:37.167867 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a02508b4-d5d2-4cca-96b7-f786a6d996eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:37.168047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9c9b69ae-0c61-4f67-b333-a343b59aaf21 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:37.168140 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a02508b4-d5d2-4cca-96b7-f786a6d996eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:37.168693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a02508b4-d5d2-4cca-96b7-f786a6d996eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:37.593826 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9c9b69ae-0c61-4f67-b333-a343b59aaf21 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:37.601459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a02508b4-d5d2-4cca-96b7-f786a6d996eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:37.603621 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9c9b69ae-0c61-4f67-b333-a343b59aaf21 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.459679 Jun 29 08:35:37.604640 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 25/51] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:37 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:37.609900 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a68cb24e-bc8d-4b22-8992-6b568899fe9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:37.610583 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a68cb24e-bc8d-4b22-8992-6b568899fe9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:37.617334 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a68cb24e-bc8d-4b22-8992-6b568899fe9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:37.617865 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a68cb24e-bc8d-4b22-8992-6b568899fe9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:37.618733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a68cb24e-bc8d-4b22-8992-6b568899fe9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:37.619328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a68cb24e-bc8d-4b22-8992-6b568899fe9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:37.626247 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a02508b4-d5d2-4cca-96b7-f786a6d996eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.507409 Jun 29 08:35:37.639270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 27/52] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:37 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:37.639270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:37.639270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:37.644767 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:37.645286 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:37.645650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:37.646409 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:37.647114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:37.725953 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:37.734430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:37.736344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:37.738025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bd42e613-11fb-4f86-b6ed-3bbae5123bf1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.105373 Jun 29 08:35:37.738578 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 28/53] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:37 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:37.791635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a68cb24e-bc8d-4b22-8992-6b568899fe9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:37.799308 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a68cb24e-bc8d-4b22-8992-6b568899fe9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.193443 Jun 29 08:35:37.800355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 26/54] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:37 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:38.621166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-aa807714-c1a2-4ffa-a231-f0d2ee57f960 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:38.621805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-aa807714-c1a2-4ffa-a231-f0d2ee57f960 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:38.628483 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aa807714-c1a2-4ffa-a231-f0d2ee57f960 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:38.628933 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aa807714-c1a2-4ffa-a231-f0d2ee57f960 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:38.629732 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aa807714-c1a2-4ffa-a231-f0d2ee57f960 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:38.630534 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aa807714-c1a2-4ffa-a231-f0d2ee57f960 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:38.651147 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4267a77d-ce25-43af-845d-e93486ced32e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:38.651801 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4267a77d-ce25-43af-845d-e93486ced32e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:38.657136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:38.665485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4267a77d-ce25-43af-845d-e93486ced32e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:38.665922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4267a77d-ce25-43af-845d-e93486ced32e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:38.666735 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4267a77d-ce25-43af-845d-e93486ced32e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:38.667149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4267a77d-ce25-43af-845d-e93486ced32e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:38.762544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=26 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:38.883555 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-aa807714-c1a2-4ffa-a231-f0d2ee57f960 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:38.898104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-aa807714-c1a2-4ffa-a231-f0d2ee57f960 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.280732 Jun 29 08:35:38.907719 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 29/55] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:38 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:38.909867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4267a77d-ce25-43af-845d-e93486ced32e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:38.912958 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:38.916445 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:38.918723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4267a77d-ce25-43af-845d-e93486ced32e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.272133 Jun 29 08:35:38.919923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 27/56] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:38 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:38.925302 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3bcc2dcb-ba09-433b-a4a2-31c4f5c92721 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:38.926155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3bcc2dcb-ba09-433b-a4a2-31c4f5c92721 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:38.932980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:38.933777 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3bcc2dcb-ba09-433b-a4a2-31c4f5c92721 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:38.934044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:38.934570 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3bcc2dcb-ba09-433b-a4a2-31c4f5c92721 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:38.935158 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:38.935751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:38.939010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3bcc2dcb-ba09-433b-a4a2-31c4f5c92721 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:38.939568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3bcc2dcb-ba09-433b-a4a2-31c4f5c92721 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:39.040715 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:39.049054 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:39.050892 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:39.052168 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7e32d1a6-314d-4c46-a643-dcc02525afe7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.143069 Jun 29 08:35:39.055294 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:38 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:39.114115 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3bcc2dcb-ba09-433b-a4a2-31c4f5c92721 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:39.122545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3bcc2dcb-ba09-433b-a4a2-31c4f5c92721 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.200926 Jun 29 08:35:39.123779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 28/58] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:38 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:39.921694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-50e6e91d-2f6f-4d02-95b5-8af9ad0a6ea0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:39.922311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-50e6e91d-2f6f-4d02-95b5-8af9ad0a6ea0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:39.928165 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=24 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:39.936266 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-afcc5421-049a-432e-93a1-6975f4c58df4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:39.936897 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-afcc5421-049a-432e-93a1-6975f4c58df4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:39.942378 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50e6e91d-2f6f-4d02-95b5-8af9ad0a6ea0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:39.942841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50e6e91d-2f6f-4d02-95b5-8af9ad0a6ea0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:39.943736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50e6e91d-2f6f-4d02-95b5-8af9ad0a6ea0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:39.944064 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50e6e91d-2f6f-4d02-95b5-8af9ad0a6ea0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:39.951760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-afcc5421-049a-432e-93a1-6975f4c58df4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:39.952195 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-afcc5421-049a-432e-93a1-6975f4c58df4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:39.952969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-afcc5421-049a-432e-93a1-6975f4c58df4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:39.953395 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-afcc5421-049a-432e-93a1-6975f4c58df4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:40.241402 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-50e6e91d-2f6f-4d02-95b5-8af9ad0a6ea0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:40.243860 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-afcc5421-049a-432e-93a1-6975f4c58df4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:40.251827 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-afcc5421-049a-432e-93a1-6975f4c58df4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.319356 Jun 29 08:35:40.253132 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:39 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:40.254023 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-50e6e91d-2f6f-4d02-95b5-8af9ad0a6ea0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.332783 Jun 29 08:35:40.263490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 31/60] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:39 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:40.267364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:40.268168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:40.269909 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-21ba450f-49bb-439c-8d7f-90075647ceb0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:40.271017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-21ba450f-49bb-439c-8d7f-90075647ceb0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:40.275043 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:40.275493 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:40.276262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:40.276697 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:40.278924 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-21ba450f-49bb-439c-8d7f-90075647ceb0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:40.279400 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-21ba450f-49bb-439c-8d7f-90075647ceb0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:40.280330 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-21ba450f-49bb-439c-8d7f-90075647ceb0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:40.280904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-21ba450f-49bb-439c-8d7f-90075647ceb0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:40.351437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:40.364042 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:40.368993 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:40.370452 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-37fbec8a-cdcc-4b75-9833-f51a771628d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.116230 Jun 29 08:35:40.383843 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:40 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:40.475504 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-21ba450f-49bb-439c-8d7f-90075647ceb0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:40.483188 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-21ba450f-49bb-439c-8d7f-90075647ceb0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.224958 Jun 29 08:35:40.483748 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 32/62] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:40 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:41.269766 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2b454357-8cbd-4a77-8e6c-b5cd3e130c09 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:41.270356 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2b454357-8cbd-4a77-8e6c-b5cd3e130c09 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:41.277276 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2b454357-8cbd-4a77-8e6c-b5cd3e130c09 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:41.278044 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2b454357-8cbd-4a77-8e6c-b5cd3e130c09 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:41.278297 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-53b41fc9-b9f9-4d2b-a557-a388801d8261 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:41.278972 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-53b41fc9-b9f9-4d2b-a557-a388801d8261 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:41.279902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2b454357-8cbd-4a77-8e6c-b5cd3e130c09 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:41.280616 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2b454357-8cbd-4a77-8e6c-b5cd3e130c09 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:41.285270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53b41fc9-b9f9-4d2b-a557-a388801d8261 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:41.286141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53b41fc9-b9f9-4d2b-a557-a388801d8261 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:41.287360 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53b41fc9-b9f9-4d2b-a557-a388801d8261 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:41.287796 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53b41fc9-b9f9-4d2b-a557-a388801d8261 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:41.492645 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-53b41fc9-b9f9-4d2b-a557-a388801d8261 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:41.496959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2b454357-8cbd-4a77-8e6c-b5cd3e130c09 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:41.501964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-53b41fc9-b9f9-4d2b-a557-a388801d8261 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.227398 Jun 29 08:35:41.504766 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 33/63] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:41 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:41.505049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2b454357-8cbd-4a77-8e6c-b5cd3e130c09 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.239116 Jun 29 08:35:41.506023 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 31/64] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:41 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:35:41.522811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:41.523518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:41.523869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5b884de9-d65d-44f3-9342-fa70a0f58e71 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:41.524615 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5b884de9-d65d-44f3-9342-fa70a0f58e71 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:41.531837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b884de9-d65d-44f3-9342-fa70a0f58e71 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:41.532502 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b884de9-d65d-44f3-9342-fa70a0f58e71 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:41.533404 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b884de9-d65d-44f3-9342-fa70a0f58e71 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:41.534263 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b884de9-d65d-44f3-9342-fa70a0f58e71 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:41.535522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:41.536067 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:41.536839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:41.537457 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:41.627984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:41.636164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:41.637669 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:41.638854 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1d96d997-e368-4c59-b2a4-28ac66ada7ad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.126440 Jun 29 08:35:41.639374 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 34/65] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:41 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:41.691067 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5b884de9-d65d-44f3-9342-fa70a0f58e71 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:41.699069 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5b884de9-d65d-44f3-9342-fa70a0f58e71 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.179608 Jun 29 08:35:41.699642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 32/66] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:41 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:42.523555 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d3c5f6bd-6a84-479c-9a24-17ea3dbe74ca tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:42.524077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-21818f1c-bd77-4a7c-b0ee-e52630553743 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:42.524810 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-21818f1c-bd77-4a7c-b0ee-e52630553743 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:42.525463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d3c5f6bd-6a84-479c-9a24-17ea3dbe74ca tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:42.531419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-21818f1c-bd77-4a7c-b0ee-e52630553743 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:42.531960 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-21818f1c-bd77-4a7c-b0ee-e52630553743 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:42.532702 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-21818f1c-bd77-4a7c-b0ee-e52630553743 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:42.533258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-21818f1c-bd77-4a7c-b0ee-e52630553743 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:42.533721 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c5f6bd-6a84-479c-9a24-17ea3dbe74ca tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:42.534174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c5f6bd-6a84-479c-9a24-17ea3dbe74ca tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:42.534949 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c5f6bd-6a84-479c-9a24-17ea3dbe74ca tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:42.535374 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c5f6bd-6a84-479c-9a24-17ea3dbe74ca tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:42.725951 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d3c5f6bd-6a84-479c-9a24-17ea3dbe74ca tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:42.729061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-21818f1c-bd77-4a7c-b0ee-e52630553743 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:42.733461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d3c5f6bd-6a84-479c-9a24-17ea3dbe74ca tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.215008 Jun 29 08:35:42.734025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:42 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:42.737467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-21818f1c-bd77-4a7c-b0ee-e52630553743 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.218201 Jun 29 08:35:42.737992 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 33/68] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:42 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:42.738404 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:42.739206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:42.745268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:42.745878 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:42.746629 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:42.747073 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:42.747183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7ebd9b05-04a8-4ebb-b574-13142387f1b5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:42.747757 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7ebd9b05-04a8-4ebb-b574-13142387f1b5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:42.754012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7ebd9b05-04a8-4ebb-b574-13142387f1b5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:42.754453 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7ebd9b05-04a8-4ebb-b574-13142387f1b5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:42.755529 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7ebd9b05-04a8-4ebb-b574-13142387f1b5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:42.756058 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7ebd9b05-04a8-4ebb-b574-13142387f1b5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:42.824942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:42.833486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:42.835052 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:42.836148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-10369c41-ae31-4585-b1e7-d41143bbea77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.101247 Jun 29 08:35:42.836706 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 36/69] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:42 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:42.924805 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7ebd9b05-04a8-4ebb-b574-13142387f1b5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:42.932728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7ebd9b05-04a8-4ebb-b574-13142387f1b5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.193627 Jun 29 08:35:42.933447 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 34/70] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:42 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:43.750766 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4740bca5-e0fc-4aea-bf82-89825fa0e565 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:43.751381 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4740bca5-e0fc-4aea-bf82-89825fa0e565 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:43.753235 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-97561d12-54b7-49c8-bc6d-b5d1c3870432 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:43.754384 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-97561d12-54b7-49c8-bc6d-b5d1c3870432 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:43.758012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4740bca5-e0fc-4aea-bf82-89825fa0e565 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:43.758491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4740bca5-e0fc-4aea-bf82-89825fa0e565 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:43.759310 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4740bca5-e0fc-4aea-bf82-89825fa0e565 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:43.759739 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4740bca5-e0fc-4aea-bf82-89825fa0e565 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:43.761081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97561d12-54b7-49c8-bc6d-b5d1c3870432 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:43.761546 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97561d12-54b7-49c8-bc6d-b5d1c3870432 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:43.762304 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97561d12-54b7-49c8-bc6d-b5d1c3870432 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:43.762727 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97561d12-54b7-49c8-bc6d-b5d1c3870432 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:43.986721 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4740bca5-e0fc-4aea-bf82-89825fa0e565 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:43.989945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-97561d12-54b7-49c8-bc6d-b5d1c3870432 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:43.994338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4740bca5-e0fc-4aea-bf82-89825fa0e565 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.247569 Jun 29 08:35:43.994900 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 37/71] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:43 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:43.997689 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-97561d12-54b7-49c8-bc6d-b5d1c3870432 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.248255 Jun 29 08:35:44.000041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 35/72] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:43 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:44.000172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:44.000172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:44.003960 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-69d23ec2-3839-4fb9-bdb5-716fdb3d77fa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:44.004640 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-69d23ec2-3839-4fb9-bdb5-716fdb3d77fa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:44.005806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:44.006205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:44.007160 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:44.007544 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:44.011357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-69d23ec2-3839-4fb9-bdb5-716fdb3d77fa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:44.011875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-69d23ec2-3839-4fb9-bdb5-716fdb3d77fa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:44.012636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-69d23ec2-3839-4fb9-bdb5-716fdb3d77fa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:44.013060 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-69d23ec2-3839-4fb9-bdb5-716fdb3d77fa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:44.078891 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:44.090734 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:44.090734 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:44.091067 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-334b0174-ceff-4ed8-b886-736cb05671d0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.095051 Jun 29 08:35:44.091498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 38/73] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:43 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:44.173666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-69d23ec2-3839-4fb9-bdb5-716fdb3d77fa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:44.181387 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-69d23ec2-3839-4fb9-bdb5-716fdb3d77fa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.182161 Jun 29 08:35:44.181942 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 36/74] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:43 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:45.012702 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0df53116-1691-48e5-b069-6302d99229e0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:45.013356 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0df53116-1691-48e5-b069-6302d99229e0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:45.015422 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-19a16286-322b-4a37-92cd-8a368bd6f2e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:45.016108 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-19a16286-322b-4a37-92cd-8a368bd6f2e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:45.020192 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0df53116-1691-48e5-b069-6302d99229e0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:45.020622 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0df53116-1691-48e5-b069-6302d99229e0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:45.021513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0df53116-1691-48e5-b069-6302d99229e0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:45.022014 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0df53116-1691-48e5-b069-6302d99229e0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:45.022138 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19a16286-322b-4a37-92cd-8a368bd6f2e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:45.022585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19a16286-322b-4a37-92cd-8a368bd6f2e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:45.023385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19a16286-322b-4a37-92cd-8a368bd6f2e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:45.025270 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19a16286-322b-4a37-92cd-8a368bd6f2e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:45.232836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-19a16286-322b-4a37-92cd-8a368bd6f2e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:45.240520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-19a16286-322b-4a37-92cd-8a368bd6f2e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.229278 Jun 29 08:35:45.241086 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 37/75] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:45 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:45.245530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:45.246116 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:45.249404 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0df53116-1691-48e5-b069-6302d99229e0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:45.252220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:45.252658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:45.253602 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:45.254026 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:45.258576 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0df53116-1691-48e5-b069-6302d99229e0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.250045 Jun 29 08:35:45.259550 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 39/76] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:45 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:45.264271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ad1204ac-7ba8-4a5a-aa3a-0e3e2589e614 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:45.264897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ad1204ac-7ba8-4a5a-aa3a-0e3e2589e614 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:45.271012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad1204ac-7ba8-4a5a-aa3a-0e3e2589e614 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:45.271493 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad1204ac-7ba8-4a5a-aa3a-0e3e2589e614 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:45.272248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad1204ac-7ba8-4a5a-aa3a-0e3e2589e614 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:45.272676 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad1204ac-7ba8-4a5a-aa3a-0e3e2589e614 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:45.329713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:45.338444 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:45.340338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:45.341437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ae66764c-0fab-45fe-ba8a-52654852dcac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.099419 Jun 29 08:35:45.351115 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 38/77] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:45 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:45.423224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ad1204ac-7ba8-4a5a-aa3a-0e3e2589e614 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:45.430822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ad1204ac-7ba8-4a5a-aa3a-0e3e2589e614 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.170304 Jun 29 08:35:45.431395 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 40/78] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:45 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:46.258029 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a73802cc-9531-481f-b617-1bf54c95af8f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:46.258663 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a73802cc-9531-481f-b617-1bf54c95af8f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:46.265725 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a73802cc-9531-481f-b617-1bf54c95af8f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:46.266220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a73802cc-9531-481f-b617-1bf54c95af8f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:46.266975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a73802cc-9531-481f-b617-1bf54c95af8f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:46.267394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a73802cc-9531-481f-b617-1bf54c95af8f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:46.274991 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-264b3535-bcd2-4fe7-88d5-b13d37670429 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:46.275604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-264b3535-bcd2-4fe7-88d5-b13d37670429 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:46.281687 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-264b3535-bcd2-4fe7-88d5-b13d37670429 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:46.282128 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-264b3535-bcd2-4fe7-88d5-b13d37670429 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:46.282918 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-264b3535-bcd2-4fe7-88d5-b13d37670429 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:46.283343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-264b3535-bcd2-4fe7-88d5-b13d37670429 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:46.475172 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a73802cc-9531-481f-b617-1bf54c95af8f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:46.483063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a73802cc-9531-481f-b617-1bf54c95af8f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.229121 Jun 29 08:35:46.483651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 39/79] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:46 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:46.487962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-264b3535-bcd2-4fe7-88d5-b13d37670429 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:46.488182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:46.488807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:46.495556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:46.495999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:46.496795 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:46.496931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-264b3535-bcd2-4fe7-88d5-b13d37670429 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.226042 Jun 29 08:35:46.497253 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:46.497692 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 41/80] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:46 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:35:46.502282 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-51699e17-bae8-4c5b-8690-560dbd54b752 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:46.502976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-51699e17-bae8-4c5b-8690-560dbd54b752 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:46.512038 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-51699e17-bae8-4c5b-8690-560dbd54b752 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:46.512577 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-51699e17-bae8-4c5b-8690-560dbd54b752 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:46.513421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-51699e17-bae8-4c5b-8690-560dbd54b752 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:46.513915 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-51699e17-bae8-4c5b-8690-560dbd54b752 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:46.571832 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:46.580341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:46.581830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:46.582951 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a10983f9-e901-404a-ad40-b224ffafe1e0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.098369 Jun 29 08:35:46.583526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 40/81] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:46 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:46.663026 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-51699e17-bae8-4c5b-8690-560dbd54b752 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:46.670845 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-51699e17-bae8-4c5b-8690-560dbd54b752 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.172158 Jun 29 08:35:46.671386 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 42/82] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:46 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:47.501912 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-61bb1fbc-1725-41b5-ba72-bef7a74f5469 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:47.502518 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-61bb1fbc-1725-41b5-ba72-bef7a74f5469 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:47.509763 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-61bb1fbc-1725-41b5-ba72-bef7a74f5469 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:47.510226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-61bb1fbc-1725-41b5-ba72-bef7a74f5469 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:47.511012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-61bb1fbc-1725-41b5-ba72-bef7a74f5469 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:47.511437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-61bb1fbc-1725-41b5-ba72-bef7a74f5469 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:47.513548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9503b616-74df-4044-9465-cec04566de43 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:47.514223 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9503b616-74df-4044-9465-cec04566de43 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:47.520696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9503b616-74df-4044-9465-cec04566de43 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:47.521440 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9503b616-74df-4044-9465-cec04566de43 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:47.522326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9503b616-74df-4044-9465-cec04566de43 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:47.522796 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9503b616-74df-4044-9465-cec04566de43 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:47.542509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:47.706677 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-61bb1fbc-1725-41b5-ba72-bef7a74f5469 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:47.711537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9503b616-74df-4044-9465-cec04566de43 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:47.714278 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-61bb1fbc-1725-41b5-ba72-bef7a74f5469 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.218445 Jun 29 08:35:47.715435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 41/83] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:47 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:47.719616 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:47.720209 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:47.720330 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9503b616-74df-4044-9465-cec04566de43 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.210799 Jun 29 08:35:47.720931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 43/84] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:47 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:47.726044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ac9b5477-ff56-48e0-b8d9-7226b1ccb711 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:47.726620 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:47.727073 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ac9b5477-ff56-48e0-b8d9-7226b1ccb711 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:47.727221 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:47.727858 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:47.728279 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:47.733424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac9b5477-ff56-48e0-b8d9-7226b1ccb711 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:47.733862 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac9b5477-ff56-48e0-b8d9-7226b1ccb711 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:47.734802 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac9b5477-ff56-48e0-b8d9-7226b1ccb711 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:47.735233 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac9b5477-ff56-48e0-b8d9-7226b1ccb711 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:47.809294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:47.817687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:47.819231 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:47.820345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8649bc5b-e2d5-4dd9-a4c8-a2608140019c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1334 microversion: 2.20 time: 0.104228 Jun 29 08:35:47.821155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 42/85] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:47 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:47.882040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ac9b5477-ff56-48e0-b8d9-7226b1ccb711 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:47.889757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ac9b5477-ff56-48e0-b8d9-7226b1ccb711 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.167588 Jun 29 08:35:47.890317 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 44/86] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:47 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:48.735683 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4848a509-aeb0-4b43-b805-ffdab8cfbbac tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:48.736627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4848a509-aeb0-4b43-b805-ffdab8cfbbac tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:48.741221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b550c9bd-225f-40be-8f62-e238917ce4cf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:48.742314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b550c9bd-225f-40be-8f62-e238917ce4cf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:48.747615 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4848a509-aeb0-4b43-b805-ffdab8cfbbac tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:48.748369 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4848a509-aeb0-4b43-b805-ffdab8cfbbac tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:48.750032 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4848a509-aeb0-4b43-b805-ffdab8cfbbac tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:48.750959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4848a509-aeb0-4b43-b805-ffdab8cfbbac tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:48.752322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b550c9bd-225f-40be-8f62-e238917ce4cf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:48.753102 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b550c9bd-225f-40be-8f62-e238917ce4cf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:48.754546 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b550c9bd-225f-40be-8f62-e238917ce4cf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:48.755459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b550c9bd-225f-40be-8f62-e238917ce4cf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:48.760459 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:49.001393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b550c9bd-225f-40be-8f62-e238917ce4cf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:49.012517 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b550c9bd-225f-40be-8f62-e238917ce4cf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.274429 Jun 29 08:35:49.013601 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 45/87] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:48 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:49.022767 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:49.028587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:49.037490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:49.037923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:49.040237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:49.040237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:49.054869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4848a509-aeb0-4b43-b805-ffdab8cfbbac tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:49.071260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4848a509-aeb0-4b43-b805-ffdab8cfbbac tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.341894 Jun 29 08:35:49.073925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 43/88] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:48 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:49.088299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-41881e98-362b-412c-8f84-cb43826cd351 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:49.090817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-41881e98-362b-412c-8f84-cb43826cd351 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:49.110364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41881e98-362b-412c-8f84-cb43826cd351 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:49.111394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41881e98-362b-412c-8f84-cb43826cd351 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:49.113385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41881e98-362b-412c-8f84-cb43826cd351 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:49.114050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41881e98-362b-412c-8f84-cb43826cd351 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:49.348839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:49.358986 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:49.360867 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:49.362147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d1d49406-7624-43d6-b450-326acc65e033 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1342 microversion: 2.20 time: 0.347447 Jun 29 08:35:49.363419 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 46/89] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:49 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1342 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:49.538853 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-41881e98-362b-412c-8f84-cb43826cd351 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:49.549250 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-41881e98-362b-412c-8f84-cb43826cd351 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.473312 Jun 29 08:35:49.550177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 44/90] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:49 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:50.032367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ac351aca-7a2c-417c-8835-7aa804c50484 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:50.034425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ac351aca-7a2c-417c-8835-7aa804c50484 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:50.058158 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac351aca-7a2c-417c-8835-7aa804c50484 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:50.058608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac351aca-7a2c-417c-8835-7aa804c50484 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:50.059600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac351aca-7a2c-417c-8835-7aa804c50484 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:50.060369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac351aca-7a2c-417c-8835-7aa804c50484 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:50.090731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-72c32e36-c1d6-43b5-9cbf-50324ef4fbb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:50.091971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-72c32e36-c1d6-43b5-9cbf-50324ef4fbb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:50.100717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72c32e36-c1d6-43b5-9cbf-50324ef4fbb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:50.101158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72c32e36-c1d6-43b5-9cbf-50324ef4fbb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:50.102030 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72c32e36-c1d6-43b5-9cbf-50324ef4fbb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:50.102712 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72c32e36-c1d6-43b5-9cbf-50324ef4fbb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:50.515750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ac351aca-7a2c-417c-8835-7aa804c50484 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:50.529351 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-72c32e36-c1d6-43b5-9cbf-50324ef4fbb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:50.538738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ac351aca-7a2c-417c-8835-7aa804c50484 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.510632 Jun 29 08:35:50.541532 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 47/91] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:50 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:50.553266 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-72c32e36-c1d6-43b5-9cbf-50324ef4fbb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.467251 Jun 29 08:35:50.562520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 45/92] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:50 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:50.566649 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:50.576303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:50.576600 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-081ee6eb-f2e0-4406-a254-6c7e6f91d973 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:50.577258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-081ee6eb-f2e0-4406-a254-6c7e6f91d973 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:50.586897 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-081ee6eb-f2e0-4406-a254-6c7e6f91d973 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:50.587651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-081ee6eb-f2e0-4406-a254-6c7e6f91d973 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:50.596491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:50.600376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-081ee6eb-f2e0-4406-a254-6c7e6f91d973 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:50.601255 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-081ee6eb-f2e0-4406-a254-6c7e6f91d973 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:50.604444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:50.607622 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:50.610107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:51.022632 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:51.032367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:51.040938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:51.042117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-20567d8c-1f5f-4897-ada1-2e62afa4a449 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1340 microversion: 2.20 time: 0.488096 Jun 29 08:35:51.053521 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 48/93] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:50 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1340 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:51.264112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-081ee6eb-f2e0-4406-a254-6c7e6f91d973 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:51.276112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-081ee6eb-f2e0-4406-a254-6c7e6f91d973 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.701927 Jun 29 08:35:51.276846 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 46/94] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:50 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:51.560194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ef9bb7bf-cc79-406d-a3c7-e157de29a6d2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:51.560795 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ef9bb7bf-cc79-406d-a3c7-e157de29a6d2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:51.569156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef9bb7bf-cc79-406d-a3c7-e157de29a6d2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:51.569964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef9bb7bf-cc79-406d-a3c7-e157de29a6d2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:51.571175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef9bb7bf-cc79-406d-a3c7-e157de29a6d2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:51.571848 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef9bb7bf-cc79-406d-a3c7-e157de29a6d2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:51.580662 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0b25c199-1358-44e9-bb99-b4795c9aefc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:51.581623 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0b25c199-1358-44e9-bb99-b4795c9aefc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:51.593394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0b25c199-1358-44e9-bb99-b4795c9aefc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:51.593874 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0b25c199-1358-44e9-bb99-b4795c9aefc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:51.596896 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0b25c199-1358-44e9-bb99-b4795c9aefc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:51.597538 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0b25c199-1358-44e9-bb99-b4795c9aefc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.279242 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0b25c199-1358-44e9-bb99-b4795c9aefc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:52.291784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0b25c199-1358-44e9-bb99-b4795c9aefc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.717180 Jun 29 08:35:52.292673 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 47/95] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:51 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:52.312917 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:52.313531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:52.327964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.331294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.334271 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.334645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.346769 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ef9bb7bf-cc79-406d-a3c7-e157de29a6d2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:52.361134 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ef9bb7bf-cc79-406d-a3c7-e157de29a6d2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.806098 Jun 29 08:35:52.364898 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 49/96] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:51 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:52.473834 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-2fd54ede-e1fe-4947-a0ed-d9f41a39b9a6 req-873b6874-02bb-47a1-b725-f36f04492fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f1f6d1-d03f-4304-b607-4ea8870be425", "tag": "b9ea90f6-200e-4036-bc3d-b3961c2cd7f6"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:52.486788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-2fd54ede-e1fe-4947-a0ed-d9f41a39b9a6 req-873b6874-02bb-47a1-b725-f36f04492fa5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.487442 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-2fd54ede-e1fe-4947-a0ed-d9f41a39b9a6 req-873b6874-02bb-47a1-b725-f36f04492fa5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.513601 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-2fd54ede-e1fe-4947-a0ed-d9f41a39b9a6 req-873b6874-02bb-47a1-b725-f36f04492fa5 service nova] Creating event network-changed:b9ea90f6-200e-4036-bc3d-b3961c2cd7f6 for instance b8f1f6d1-d03f-4304-b607-4ea8870be425 on hv-cinder-79760 Jun 29 08:35:52.514134 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-2fd54ede-e1fe-4947-a0ed-d9f41a39b9a6 req-873b6874-02bb-47a1-b725-f36f04492fa5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 08:35:52.515266 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70903574-6ed0-4724-9756-f7c0a4ed745f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.515883 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70903574-6ed0-4724-9756-f7c0a4ed745f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.516822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70903574-6ed0-4724-9756-f7c0a4ed745f None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.517404 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70903574-6ed0-4724-9756-f7c0a4ed745f None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.527864 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.compute.rpcapi [None req-70903574-6ed0-4724-9756-f7c0a4ed745f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 08:35:52.528776 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70903574-6ed0-4724-9756-f7c0a4ed745f None None] Releasing lock "compute-rpcapi-router" {{(pid=124266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 08:35:52.540221 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:52.547593 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-70903574-6ed0-4724-9756-f7c0a4ed745f None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178155 Jun 29 08:35:52.548215 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 50/97] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:52.551172 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:52.552779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:52.553959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5c1785b1-f13d-4f75-b47e-cb472b87bb0f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.260303 Jun 29 08:35:52.554345 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1ebe94c0-958b-46b5-9699-f024ea18d6bd tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:52.555215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 48/98] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:52 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:52.555345 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1ebe94c0-958b-46b5-9699-f024ea18d6bd tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:52.561649 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebe94c0-958b-46b5-9699-f024ea18d6bd tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.562463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebe94c0-958b-46b5-9699-f024ea18d6bd tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.563396 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebe94c0-958b-46b5-9699-f024ea18d6bd tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.564123 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebe94c0-958b-46b5-9699-f024ea18d6bd tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.703907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1ebe94c0-958b-46b5-9699-f024ea18d6bd tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:52.713390 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1ebe94c0-958b-46b5-9699-f024ea18d6bd tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.163843 Jun 29 08:35:52.713719 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-f871303f-f212-4ef8-b0a0-d4066b15caee req-b48109e7-e5ac-48eb-9f40-a2d5bba1f762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ff4bf7-d905-4584-98f7-26236c14a7d8", "tag": "2ed55c94-eef8-437e-ba0f-2a7792313f0d"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:52.714091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 51/99] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:52 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:52.725243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f871303f-f212-4ef8-b0a0-d4066b15caee req-b48109e7-e5ac-48eb-9f40-a2d5bba1f762 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.725533 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f871303f-f212-4ef8-b0a0-d4066b15caee req-b48109e7-e5ac-48eb-9f40-a2d5bba1f762 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.744956 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-f871303f-f212-4ef8-b0a0-d4066b15caee req-b48109e7-e5ac-48eb-9f40-a2d5bba1f762 service nova] Creating event network-changed:2ed55c94-eef8-437e-ba0f-2a7792313f0d for instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 on hv-cinder-79760 Jun 29 08:35:52.745479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f871303f-f212-4ef8-b0a0-d4066b15caee req-b48109e7-e5ac-48eb-9f40-a2d5bba1f762 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124265) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 08:35:52.746623 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68ab2586-fe29-40ac-813d-7808bead3f01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.747035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68ab2586-fe29-40ac-813d-7808bead3f01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.747848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68ab2586-fe29-40ac-813d-7808bead3f01 None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:52.748555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68ab2586-fe29-40ac-813d-7808bead3f01 None None] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:52.757479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.compute.rpcapi [None req-68ab2586-fe29-40ac-813d-7808bead3f01 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 08:35:52.759138 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68ab2586-fe29-40ac-813d-7808bead3f01 None None] Releasing lock "compute-rpcapi-router" {{(pid=124265) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 08:35:52.783313 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-68ab2586-fe29-40ac-813d-7808bead3f01 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226556 Jun 29 08:35:52.783920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 49/100] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:53.308682 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-db8ce755-d3ae-4c25-9ab5-7f7ec161c706 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:53.309288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-db8ce755-d3ae-4c25-9ab5-7f7ec161c706 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:53.315534 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db8ce755-d3ae-4c25-9ab5-7f7ec161c706 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:53.315976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db8ce755-d3ae-4c25-9ab5-7f7ec161c706 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:53.316736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db8ce755-d3ae-4c25-9ab5-7f7ec161c706 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:53.317165 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db8ce755-d3ae-4c25-9ab5-7f7ec161c706 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:53.382017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f4e9606c-e80d-4ef9-b77d-4e0baea66a75 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:53.383081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f4e9606c-e80d-4ef9-b77d-4e0baea66a75 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:53.389685 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f4e9606c-e80d-4ef9-b77d-4e0baea66a75 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:53.390125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f4e9606c-e80d-4ef9-b77d-4e0baea66a75 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:53.390963 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f4e9606c-e80d-4ef9-b77d-4e0baea66a75 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:53.391348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f4e9606c-e80d-4ef9-b77d-4e0baea66a75 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:53.563800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-db8ce755-d3ae-4c25-9ab5-7f7ec161c706 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:53.573064 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-db8ce755-d3ae-4c25-9ab5-7f7ec161c706 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.268248 Jun 29 08:35:53.573651 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 52/101] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:53 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:53.579596 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:53.580249 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:53.589262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:53.590046 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:53.590845 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:53.591274 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:53.609970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f4e9606c-e80d-4ef9-b77d-4e0baea66a75 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:53.618632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f4e9606c-e80d-4ef9-b77d-4e0baea66a75 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.240140 Jun 29 08:35:53.623400 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 50/102] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:53 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:53.728996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:53.731630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3142a113-7971-4205-be0e-c5f31e4e8a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:53.732385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3142a113-7971-4205-be0e-c5f31e4e8a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:53.737583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:53.738819 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3142a113-7971-4205-be0e-c5f31e4e8a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:53.739133 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:53.739378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3142a113-7971-4205-be0e-c5f31e4e8a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:53.740214 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3142a113-7971-4205-be0e-c5f31e4e8a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:53.740309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b638bea2-bdb2-4854-8842-d0cb262b1e99 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.165605 Jun 29 08:35:53.740816 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 53/103] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:53 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:53.740958 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3142a113-7971-4205-be0e-c5f31e4e8a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:53.883893 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3142a113-7971-4205-be0e-c5f31e4e8a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:53.892432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3142a113-7971-4205-be0e-c5f31e4e8a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.165534 Jun 29 08:35:53.893329 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 51/104] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:53 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:54.564367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-372dd698-451e-4f6b-a9ad-2c5e8e620e91 req-aca52fdb-b4e4-4cd9-8144-fb2e9af37fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e23553-4467-4f79-969b-21758f4c244a", "tag": "13059f8a-34b7-4a4a-a56b-e4bfe5599234"}, {"name": "network-changed", "server_uuid": "25f7924b-e691-4d2b-8ea7-a4438a64d3b8", "tag": "71f36781-07b8-496d-a3d0-c0d224617705"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:54.573500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-372dd698-451e-4f6b-a9ad-2c5e8e620e91 req-aca52fdb-b4e4-4cd9-8144-fb2e9af37fa8 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.573927 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-372dd698-451e-4f6b-a9ad-2c5e8e620e91 req-aca52fdb-b4e4-4cd9-8144-fb2e9af37fa8 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:54.587123 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-372dd698-451e-4f6b-a9ad-2c5e8e620e91 req-aca52fdb-b4e4-4cd9-8144-fb2e9af37fa8 service nova] Creating event network-changed:13059f8a-34b7-4a4a-a56b-e4bfe5599234 for instance 92e23553-4467-4f79-969b-21758f4c244a on hv-cinder-79760 Jun 29 08:35:54.587669 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-372dd698-451e-4f6b-a9ad-2c5e8e620e91 req-aca52fdb-b4e4-4cd9-8144-fb2e9af37fa8 service nova] Creating event network-changed:71f36781-07b8-496d-a3d0-c0d224617705 for instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 on hv-cinder-79760 Jun 29 08:35:54.591454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1c32b572-2c54-4717-a8b6-a617fa900ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:54.592796 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1c32b572-2c54-4717-a8b6-a617fa900ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:54.594830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-372dd698-451e-4f6b-a9ad-2c5e8e620e91 req-aca52fdb-b4e4-4cd9-8144-fb2e9af37fa8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035526 Jun 29 08:35:54.595424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 54/105] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:54.604367 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c32b572-2c54-4717-a8b6-a617fa900ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.604813 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c32b572-2c54-4717-a8b6-a617fa900ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:54.605632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c32b572-2c54-4717-a8b6-a617fa900ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.606060 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c32b572-2c54-4717-a8b6-a617fa900ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:54.636509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6114babf-27e9-4242-81e9-77a2ae9392d7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:54.637418 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6114babf-27e9-4242-81e9-77a2ae9392d7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:54.645476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6114babf-27e9-4242-81e9-77a2ae9392d7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.645919 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6114babf-27e9-4242-81e9-77a2ae9392d7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:54.646681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6114babf-27e9-4242-81e9-77a2ae9392d7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.647172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6114babf-27e9-4242-81e9-77a2ae9392d7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:54.792930 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1c32b572-2c54-4717-a8b6-a617fa900ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:54.804282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1c32b572-2c54-4717-a8b6-a617fa900ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.218249 Jun 29 08:35:54.804787 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 52/106] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:54 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:54.811221 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:54.813702 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:54.830016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.830464 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:54.831174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6114babf-27e9-4242-81e9-77a2ae9392d7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:54.831305 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.831908 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:54.839000 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6114babf-27e9-4242-81e9-77a2ae9392d7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.206989 Jun 29 08:35:54.840198 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 55/107] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:54 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:54.909357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-799e9bf6-a91b-4ffa-9a89-4bac237ccdf4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:54.909967 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-799e9bf6-a91b-4ffa-9a89-4bac237ccdf4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:54.916290 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-799e9bf6-a91b-4ffa-9a89-4bac237ccdf4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.916952 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-799e9bf6-a91b-4ffa-9a89-4bac237ccdf4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:54.917912 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-799e9bf6-a91b-4ffa-9a89-4bac237ccdf4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:54.918537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-799e9bf6-a91b-4ffa-9a89-4bac237ccdf4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:55.029974 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:55.038178 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:55.040061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:55.046855 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-118846c7-73d5-4b5d-969c-69b6e574166e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.233680 Jun 29 08:35:55.048258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 53/108] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:54 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:55.102798 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-799e9bf6-a91b-4ffa-9a89-4bac237ccdf4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:55.111366 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-799e9bf6-a91b-4ffa-9a89-4bac237ccdf4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.205792 Jun 29 08:35:55.111980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 56/109] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:54 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:35:55.822363 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0f1e54bd-1c78-44cb-8d07-8d2e2b26413c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:55.824494 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0f1e54bd-1c78-44cb-8d07-8d2e2b26413c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:55.833286 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0f1e54bd-1c78-44cb-8d07-8d2e2b26413c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:55.835062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0f1e54bd-1c78-44cb-8d07-8d2e2b26413c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:55.836461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0f1e54bd-1c78-44cb-8d07-8d2e2b26413c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:55.837122 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0f1e54bd-1c78-44cb-8d07-8d2e2b26413c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:55.857595 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-312303a8-89eb-4845-9ec3-c40b130fbdfb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:55.859869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-312303a8-89eb-4845-9ec3-c40b130fbdfb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:55.873219 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-312303a8-89eb-4845-9ec3-c40b130fbdfb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:55.874213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-312303a8-89eb-4845-9ec3-c40b130fbdfb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:55.876564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-312303a8-89eb-4845-9ec3-c40b130fbdfb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:55.879195 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-312303a8-89eb-4845-9ec3-c40b130fbdfb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:56.461135 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-312303a8-89eb-4845-9ec3-c40b130fbdfb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:56.471265 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-312303a8-89eb-4845-9ec3-c40b130fbdfb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.618865 Jun 29 08:35:56.475557 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 57/110] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:55 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:35:56.480749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0f1e54bd-1c78-44cb-8d07-8d2e2b26413c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:56.489281 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:56.489894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:56.492552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0f1e54bd-1c78-44cb-8d07-8d2e2b26413c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.675262 Jun 29 08:35:56.493889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 54/111] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:55 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:35:56.506369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:56.506844 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:56.507622 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:56.508057 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:56.513049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-74bd76ad-c32c-4c16-b7c5-400aaf97afc1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:56.513744 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-74bd76ad-c32c-4c16-b7c5-400aaf97afc1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:56.520035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-74bd76ad-c32c-4c16-b7c5-400aaf97afc1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:56.520560 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-74bd76ad-c32c-4c16-b7c5-400aaf97afc1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:56.531343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-74bd76ad-c32c-4c16-b7c5-400aaf97afc1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:56.532037 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-74bd76ad-c32c-4c16-b7c5-400aaf97afc1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:56.977562 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:56.981064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-74bd76ad-c32c-4c16-b7c5-400aaf97afc1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:56.986229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:56.988208 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:56.989593 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-164a6aaa-7eea-4cb9-b3a8-ece2d7eeb454 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.515571 Jun 29 08:35:56.990136 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 58/112] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:56 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:56.993464 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-74bd76ad-c32c-4c16-b7c5-400aaf97afc1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.498071 Jun 29 08:35:56.994873 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 55/113] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:56 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:57.322467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-136e6b7a-759e-4f0f-ba76-5e0b900a2875 req-01baaaef-6248-471a-9226-cae33240e9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcdb4aec-5168-4f28-b336-45afe2620e64", "tag": "4a2b788b-b706-4ae1-a969-16b817f7a8ad"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:35:57.336639 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-136e6b7a-759e-4f0f-ba76-5e0b900a2875 req-01baaaef-6248-471a-9226-cae33240e9e5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:57.337207 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-136e6b7a-759e-4f0f-ba76-5e0b900a2875 req-01baaaef-6248-471a-9226-cae33240e9e5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:57.350948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-136e6b7a-759e-4f0f-ba76-5e0b900a2875 req-01baaaef-6248-471a-9226-cae33240e9e5 service nova] Creating event network-changed:4a2b788b-b706-4ae1-a969-16b817f7a8ad for instance dcdb4aec-5168-4f28-b336-45afe2620e64 on hv-cinder-79760 Jun 29 08:35:57.356001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-136e6b7a-759e-4f0f-ba76-5e0b900a2875 req-01baaaef-6248-471a-9226-cae33240e9e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038208 Jun 29 08:35:57.356605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 59/114] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:35:57.488939 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-328d6898-358d-4d6a-a71a-286dd3a3d5ef tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:57.489515 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-328d6898-358d-4d6a-a71a-286dd3a3d5ef tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:57.495923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-328d6898-358d-4d6a-a71a-286dd3a3d5ef tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:57.496366 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-328d6898-358d-4d6a-a71a-286dd3a3d5ef tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:57.497122 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-328d6898-358d-4d6a-a71a-286dd3a3d5ef tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:57.497552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-328d6898-358d-4d6a-a71a-286dd3a3d5ef tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:57.510089 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fe75138d-3531-434e-849d-b83bdffbb4c3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:57.510834 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fe75138d-3531-434e-849d-b83bdffbb4c3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:57.518077 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fe75138d-3531-434e-849d-b83bdffbb4c3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:57.518715 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fe75138d-3531-434e-849d-b83bdffbb4c3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:57.519782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fe75138d-3531-434e-849d-b83bdffbb4c3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:57.520531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fe75138d-3531-434e-849d-b83bdffbb4c3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:57.699625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-328d6898-358d-4d6a-a71a-286dd3a3d5ef tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:57.702207 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fe75138d-3531-434e-849d-b83bdffbb4c3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:57.707807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-328d6898-358d-4d6a-a71a-286dd3a3d5ef tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.222833 Jun 29 08:35:57.708393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 56/115] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:57 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:57.710615 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fe75138d-3531-434e-849d-b83bdffbb4c3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.204916 Jun 29 08:35:57.711209 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 60/116] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:57 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:58.012261 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:58.013311 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:58.013748 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74eb5a86-eae3-4205-b55c-815cce39b13b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:58.014755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-74eb5a86-eae3-4205-b55c-815cce39b13b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:58.024289 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:58.024630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74eb5a86-eae3-4205-b55c-815cce39b13b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:58.025006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74eb5a86-eae3-4205-b55c-815cce39b13b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:58.025110 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:58.025787 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74eb5a86-eae3-4205-b55c-815cce39b13b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:58.025889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:58.026200 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74eb5a86-eae3-4205-b55c-815cce39b13b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:58.026297 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:58.232669 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:58.240910 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:58.242406 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:58.244326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cd182193-1b80-472f-bb60-8ddb4ac52a4a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.238933 Jun 29 08:35:58.249374 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 57/117] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:58 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:58.249882 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-74eb5a86-eae3-4205-b55c-815cce39b13b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:58.252354 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:35:58.257411 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-74eb5a86-eae3-4205-b55c-815cce39b13b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.250044 Jun 29 08:35:58.258074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 61/118] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:58 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:58.729052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0dfd8dd7-8b32-4ae6-8a6f-d613008ce488 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:58.729567 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0dfd8dd7-8b32-4ae6-8a6f-d613008ce488 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:58.730371 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2377ae46-49d1-4bc1-81e7-3055e4869993 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:58.731029 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2377ae46-49d1-4bc1-81e7-3055e4869993 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:58.736062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0dfd8dd7-8b32-4ae6-8a6f-d613008ce488 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:58.736502 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0dfd8dd7-8b32-4ae6-8a6f-d613008ce488 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:58.737253 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0dfd8dd7-8b32-4ae6-8a6f-d613008ce488 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:58.737551 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2377ae46-49d1-4bc1-81e7-3055e4869993 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:58.737678 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0dfd8dd7-8b32-4ae6-8a6f-d613008ce488 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:58.737979 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2377ae46-49d1-4bc1-81e7-3055e4869993 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:58.738758 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2377ae46-49d1-4bc1-81e7-3055e4869993 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:58.739185 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2377ae46-49d1-4bc1-81e7-3055e4869993 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:58.933501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0dfd8dd7-8b32-4ae6-8a6f-d613008ce488 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:58.936427 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2377ae46-49d1-4bc1-81e7-3055e4869993 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:58.941610 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0dfd8dd7-8b32-4ae6-8a6f-d613008ce488 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.218497 Jun 29 08:35:58.942499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 58/119] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:58 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:58.950006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2377ae46-49d1-4bc1-81e7-3055e4869993 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.224289 Jun 29 08:35:58.950905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 62/120] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:58 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:35:59.263415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:59.264014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:59.271037 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:59.271477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:59.272233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:59.272653 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:59.276141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-54728543-8774-4b9c-991f-527a971320ab tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:59.276793 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-54728543-8774-4b9c-991f-527a971320ab tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:59.283414 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-54728543-8774-4b9c-991f-527a971320ab tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:59.283855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-54728543-8774-4b9c-991f-527a971320ab tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:59.284614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-54728543-8774-4b9c-991f-527a971320ab tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:59.285039 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-54728543-8774-4b9c-991f-527a971320ab tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:59.636712 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:59.640959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-54728543-8774-4b9c-991f-527a971320ab tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:59.648533 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:59.650641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:35:59.651447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-54728543-8774-4b9c-991f-527a971320ab tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.382025 Jun 29 08:35:59.651808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-57e0aea1-e772-4a1c-90ad-fc53e88fd757 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.392554 Jun 29 08:35:59.652013 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 63/121] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:59 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:35:59.652653 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 59/122] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:35:59 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:35:59.962339 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-50143c29-2f29-4fa7-a026-6dcf1dc2b7e5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:59.963640 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-50143c29-2f29-4fa7-a026-6dcf1dc2b7e5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:59.968865 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2857c8c3-191d-418f-833f-0ac65f90fa48 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:35:59.969740 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2857c8c3-191d-418f-833f-0ac65f90fa48 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:35:59.973743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50143c29-2f29-4fa7-a026-6dcf1dc2b7e5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:59.974674 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50143c29-2f29-4fa7-a026-6dcf1dc2b7e5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:59.975886 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50143c29-2f29-4fa7-a026-6dcf1dc2b7e5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:59.976674 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50143c29-2f29-4fa7-a026-6dcf1dc2b7e5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:59.979651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2857c8c3-191d-418f-833f-0ac65f90fa48 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:59.980210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2857c8c3-191d-418f-833f-0ac65f90fa48 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:59.981141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2857c8c3-191d-418f-833f-0ac65f90fa48 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:35:59.981614 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2857c8c3-191d-418f-833f-0ac65f90fa48 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:35:59.986975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:00.169068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-50143c29-2f29-4fa7-a026-6dcf1dc2b7e5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:00.171858 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2857c8c3-191d-418f-833f-0ac65f90fa48 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:00.176932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-50143c29-2f29-4fa7-a026-6dcf1dc2b7e5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.220807 Jun 29 08:36:00.177488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 64/123] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:59 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:00.179485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2857c8c3-191d-418f-833f-0ac65f90fa48 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.216049 Jun 29 08:36:00.180045 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 60/124] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:35:59 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:00.672658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a3acc299-7efc-48e5-ad92-60249d19cbf6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:00.673542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:00.674168 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a3acc299-7efc-48e5-ad92-60249d19cbf6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:00.674421 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:00.684206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3acc299-7efc-48e5-ad92-60249d19cbf6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:00.684506 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:00.684955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3acc299-7efc-48e5-ad92-60249d19cbf6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:00.685251 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:00.686174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3acc299-7efc-48e5-ad92-60249d19cbf6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:00.686515 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:00.686929 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3acc299-7efc-48e5-ad92-60249d19cbf6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:00.687217 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:00.887306 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:00.890636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a3acc299-7efc-48e5-ad92-60249d19cbf6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:00.898962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:00.901261 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:00.901414 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a3acc299-7efc-48e5-ad92-60249d19cbf6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.235226 Jun 29 08:36:00.902285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 65/125] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:00 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:00.902624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-23dc0e7b-6ec7-4af7-864e-47f4996aef56 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.235600 Jun 29 08:36:00.903454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 61/126] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:00 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:01.197098 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-196a2b8e-4d1b-4c8c-b7fa-ec7aa14cb1a2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:01.197991 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-196a2b8e-4d1b-4c8c-b7fa-ec7aa14cb1a2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:01.198723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-179ea656-5f04-4968-b0d0-887ac7b62709 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:01.199398 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-179ea656-5f04-4968-b0d0-887ac7b62709 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:01.207321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-196a2b8e-4d1b-4c8c-b7fa-ec7aa14cb1a2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:01.208095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-196a2b8e-4d1b-4c8c-b7fa-ec7aa14cb1a2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:01.208527 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-179ea656-5f04-4968-b0d0-887ac7b62709 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:01.209160 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-179ea656-5f04-4968-b0d0-887ac7b62709 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:01.209319 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-196a2b8e-4d1b-4c8c-b7fa-ec7aa14cb1a2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:01.209724 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-196a2b8e-4d1b-4c8c-b7fa-ec7aa14cb1a2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:01.210125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-179ea656-5f04-4968-b0d0-887ac7b62709 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:01.210756 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-179ea656-5f04-4968-b0d0-887ac7b62709 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:01.406854 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-179ea656-5f04-4968-b0d0-887ac7b62709 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:01.410010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-196a2b8e-4d1b-4c8c-b7fa-ec7aa14cb1a2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:01.414302 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-179ea656-5f04-4968-b0d0-887ac7b62709 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.220710 Jun 29 08:36:01.415191 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 62/127] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:01 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:01.418051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-196a2b8e-4d1b-4c8c-b7fa-ec7aa14cb1a2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.227010 Jun 29 08:36:01.418711 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 66/128] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:01 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:01.923340 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-34c7ac01-c010-40a4-80b6-e2e51cc58849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:01.924344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-34c7ac01-c010-40a4-80b6-e2e51cc58849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:01.924992 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:01.925978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:01.933548 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-34c7ac01-c010-40a4-80b6-e2e51cc58849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:01.933984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-34c7ac01-c010-40a4-80b6-e2e51cc58849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:01.934215 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:01.934645 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:01.934805 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-34c7ac01-c010-40a4-80b6-e2e51cc58849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:01.935172 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-34c7ac01-c010-40a4-80b6-e2e51cc58849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:01.935423 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:01.935852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:02.128168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-34c7ac01-c010-40a4-80b6-e2e51cc58849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:02.131501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:02.136213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-34c7ac01-c010-40a4-80b6-e2e51cc58849 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.219323 Jun 29 08:36:02.136787 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 63/129] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:01 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:02.140329 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:02.142129 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:02.143276 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d887c381-8748-4066-b42d-31758332c50b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.224770 Jun 29 08:36:02.144119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 67/130] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:01 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:02.434389 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-388fdd81-6c22-4de8-b9cf-74966255a236 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:02.435049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-388fdd81-6c22-4de8-b9cf-74966255a236 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:02.435204 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-abbb9a04-04dd-46c5-a87c-165fde96eaf7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:02.435811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-abbb9a04-04dd-46c5-a87c-165fde96eaf7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:02.441383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-388fdd81-6c22-4de8-b9cf-74966255a236 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:02.441894 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-388fdd81-6c22-4de8-b9cf-74966255a236 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:02.443039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-388fdd81-6c22-4de8-b9cf-74966255a236 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:02.443175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-abbb9a04-04dd-46c5-a87c-165fde96eaf7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:02.443581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-388fdd81-6c22-4de8-b9cf-74966255a236 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:02.443949 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-abbb9a04-04dd-46c5-a87c-165fde96eaf7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:02.445151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-abbb9a04-04dd-46c5-a87c-165fde96eaf7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:02.445580 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-abbb9a04-04dd-46c5-a87c-165fde96eaf7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:02.526549 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:02.649275 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-abbb9a04-04dd-46c5-a87c-165fde96eaf7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:02.654183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-388fdd81-6c22-4de8-b9cf-74966255a236 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:02.657304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-abbb9a04-04dd-46c5-a87c-165fde96eaf7 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.225821 Jun 29 08:36:02.659324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 68/131] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:02 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:02.661948 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-388fdd81-6c22-4de8-b9cf-74966255a236 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.232061 Jun 29 08:36:02.662549 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 64/132] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:02 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:03.154323 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9ad7f0a3-bd6d-4e17-822c-99d28f6bf47c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:03.154957 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9ad7f0a3-bd6d-4e17-822c-99d28f6bf47c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:03.163624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:03.164375 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:03.164687 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ad7f0a3-bd6d-4e17-822c-99d28f6bf47c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:03.165262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ad7f0a3-bd6d-4e17-822c-99d28f6bf47c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:03.166177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ad7f0a3-bd6d-4e17-822c-99d28f6bf47c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:03.166461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:03.166626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ad7f0a3-bd6d-4e17-822c-99d28f6bf47c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:03.171808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:03.172577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:03.173371 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:03.173800 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:03.383487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9ad7f0a3-bd6d-4e17-822c-99d28f6bf47c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:03.387968 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:03.391336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9ad7f0a3-bd6d-4e17-822c-99d28f6bf47c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.241445 Jun 29 08:36:03.392280 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 69/133] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:03 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:03.397920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:03.399615 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:03.400788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4fc469df-ebc4-4d47-8dbd-f4204719c9b2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.242504 Jun 29 08:36:03.401609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 65/134] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:03 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:03.677006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6430ad01-a20f-4c0b-b735-22b8de62a2cb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:03.677635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6430ad01-a20f-4c0b-b735-22b8de62a2cb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:03.685652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6430ad01-a20f-4c0b-b735-22b8de62a2cb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:03.686853 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6430ad01-a20f-4c0b-b735-22b8de62a2cb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:03.687555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2f93d3fc-4a00-4809-8163-ed37ceac22ae tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:03.687732 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6430ad01-a20f-4c0b-b735-22b8de62a2cb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:03.688314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6430ad01-a20f-4c0b-b735-22b8de62a2cb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:03.689241 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2f93d3fc-4a00-4809-8163-ed37ceac22ae tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:03.700354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2f93d3fc-4a00-4809-8163-ed37ceac22ae tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:03.701135 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2f93d3fc-4a00-4809-8163-ed37ceac22ae tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:03.702282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2f93d3fc-4a00-4809-8163-ed37ceac22ae tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:03.702822 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2f93d3fc-4a00-4809-8163-ed37ceac22ae tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:03.904297 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6430ad01-a20f-4c0b-b735-22b8de62a2cb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:03.909247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2f93d3fc-4a00-4809-8163-ed37ceac22ae tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:03.915085 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6430ad01-a20f-4c0b-b735-22b8de62a2cb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.241982 Jun 29 08:36:03.915746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 70/135] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:03 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:03.918780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2f93d3fc-4a00-4809-8163-ed37ceac22ae tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.240730 Jun 29 08:36:03.919339 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 66/136] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:03 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:04.412273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a62e5c48-788f-4108-8636-d916bd1f05c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:04.413253 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a62e5c48-788f-4108-8636-d916bd1f05c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:04.419673 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:04.420350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:04.420911 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a62e5c48-788f-4108-8636-d916bd1f05c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:04.421354 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a62e5c48-788f-4108-8636-d916bd1f05c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:04.422107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a62e5c48-788f-4108-8636-d916bd1f05c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:04.422535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a62e5c48-788f-4108-8636-d916bd1f05c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:04.426455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:04.426927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:04.427684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:04.428105 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:04.621079 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a62e5c48-788f-4108-8636-d916bd1f05c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:04.627726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:04.631915 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a62e5c48-788f-4108-8636-d916bd1f05c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.225560 Jun 29 08:36:04.633049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 71/137] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:04 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:04.636810 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:04.638826 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:04.640661 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3ffde5fb-3a0f-4f3f-983a-73b8a6c129c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.224627 Jun 29 08:36:04.641726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 67/138] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:04 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:04.934732 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ed78619c-d7fd-4495-aeca-ad029aba0eb2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:04.935291 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ed78619c-d7fd-4495-aeca-ad029aba0eb2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:04.936280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-136f67c6-8f24-44cd-b40c-fa302880837c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:04.936948 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-136f67c6-8f24-44cd-b40c-fa302880837c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:04.942352 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed78619c-d7fd-4495-aeca-ad029aba0eb2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:04.942869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed78619c-d7fd-4495-aeca-ad029aba0eb2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:04.943699 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed78619c-d7fd-4495-aeca-ad029aba0eb2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:04.943956 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-136f67c6-8f24-44cd-b40c-fa302880837c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:04.944114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed78619c-d7fd-4495-aeca-ad029aba0eb2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:04.944376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-136f67c6-8f24-44cd-b40c-fa302880837c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:04.945213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-136f67c6-8f24-44cd-b40c-fa302880837c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:04.945679 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-136f67c6-8f24-44cd-b40c-fa302880837c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:05.144839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ed78619c-d7fd-4495-aeca-ad029aba0eb2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:05.147131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-136f67c6-8f24-44cd-b40c-fa302880837c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:05.152403 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ed78619c-d7fd-4495-aeca-ad029aba0eb2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.222902 Jun 29 08:36:05.153073 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 72/139] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:04 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:05.161199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-136f67c6-8f24-44cd-b40c-fa302880837c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.229107 Jun 29 08:36:05.161775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 68/140] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:04 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:05.649066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-49d6d91a-3c5a-4160-892d-86dd38789589 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:05.649703 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-49d6d91a-3c5a-4160-892d-86dd38789589 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:05.656355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-49d6d91a-3c5a-4160-892d-86dd38789589 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:05.656784 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-49d6d91a-3c5a-4160-892d-86dd38789589 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:05.657540 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-49d6d91a-3c5a-4160-892d-86dd38789589 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:05.657955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-49d6d91a-3c5a-4160-892d-86dd38789589 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:05.659752 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:05.660342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:05.667380 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:05.667821 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:05.668577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:05.668999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:05.856672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-49d6d91a-3c5a-4160-892d-86dd38789589 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:05.861405 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:05.864789 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-49d6d91a-3c5a-4160-892d-86dd38789589 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.219537 Jun 29 08:36:05.868853 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 73/141] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:05 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:05.870055 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:05.871598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:05.872861 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-32edbe0e-0b63-429c-b8a2-ee526e5f481d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.217139 Jun 29 08:36:05.873937 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 69/142] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:05 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:06.170586 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-765ac1d9-0331-441b-b0ea-ccb30c99bd7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:06.171917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-765ac1d9-0331-441b-b0ea-ccb30c99bd7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:06.177312 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-504c5276-cb26-492c-9d81-4c3dcef880d8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:06.178522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-765ac1d9-0331-441b-b0ea-ccb30c99bd7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:06.178795 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-504c5276-cb26-492c-9d81-4c3dcef880d8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:06.178983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-765ac1d9-0331-441b-b0ea-ccb30c99bd7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:06.179920 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-765ac1d9-0331-441b-b0ea-ccb30c99bd7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:06.180494 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-765ac1d9-0331-441b-b0ea-ccb30c99bd7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:06.186359 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-504c5276-cb26-492c-9d81-4c3dcef880d8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:06.186913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-504c5276-cb26-492c-9d81-4c3dcef880d8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:06.187768 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-504c5276-cb26-492c-9d81-4c3dcef880d8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:06.188284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-504c5276-cb26-492c-9d81-4c3dcef880d8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:06.383851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-765ac1d9-0331-441b-b0ea-ccb30c99bd7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:06.387562 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-504c5276-cb26-492c-9d81-4c3dcef880d8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:06.398021 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-504c5276-cb26-492c-9d81-4c3dcef880d8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.224383 Jun 29 08:36:06.398585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 70/143] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:06 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:06.402669 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-765ac1d9-0331-441b-b0ea-ccb30c99bd7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.236612 Jun 29 08:36:06.403252 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 74/144] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:06 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:06.887015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5578b535-7e17-4a8b-ad6c-d3e78d6357b2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:06.887015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5578b535-7e17-4a8b-ad6c-d3e78d6357b2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:06.895645 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:06.896252 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:06.903882 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:06.904267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:06.905031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:06.905447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:06.905557 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5578b535-7e17-4a8b-ad6c-d3e78d6357b2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:06.905899 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5578b535-7e17-4a8b-ad6c-d3e78d6357b2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:06.906658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5578b535-7e17-4a8b-ad6c-d3e78d6357b2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:06.907112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5578b535-7e17-4a8b-ad6c-d3e78d6357b2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:07.100100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:07.102976 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5578b535-7e17-4a8b-ad6c-d3e78d6357b2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:07.108401 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:07.109900 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:07.110682 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5578b535-7e17-4a8b-ad6c-d3e78d6357b2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.231968 Jun 29 08:36:07.111025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d2a9b9e1-6d18-496c-89b4-457b80fa4e69 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.223146 Jun 29 08:36:07.111251 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 71/145] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:06 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:07.111578 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 75/146] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:06 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:07.418558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0c798add-a62c-4b25-b051-e7be63a087e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:07.419215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0c798add-a62c-4b25-b051-e7be63a087e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:07.421172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4075b719-6915-47d3-a389-eceb933b3f45 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:07.421335 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=93 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:07.421782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4075b719-6915-47d3-a389-eceb933b3f45 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:07.424237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=98 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:07.427325 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c798add-a62c-4b25-b051-e7be63a087e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:07.427817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c798add-a62c-4b25-b051-e7be63a087e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:07.428597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c798add-a62c-4b25-b051-e7be63a087e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:07.429045 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c798add-a62c-4b25-b051-e7be63a087e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:07.430340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4075b719-6915-47d3-a389-eceb933b3f45 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:07.430826 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4075b719-6915-47d3-a389-eceb933b3f45 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:07.431628 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4075b719-6915-47d3-a389-eceb933b3f45 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:07.432099 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4075b719-6915-47d3-a389-eceb933b3f45 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:07.618809 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0c798add-a62c-4b25-b051-e7be63a087e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:07.621617 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4075b719-6915-47d3-a389-eceb933b3f45 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:07.627424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0c798add-a62c-4b25-b051-e7be63a087e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.214490 Jun 29 08:36:07.627973 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 72/147] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:07 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:07.630470 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4075b719-6915-47d3-a389-eceb933b3f45 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.213513 Jun 29 08:36:07.631296 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 76/148] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:07 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:08.128158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ee61a13b-3f63-42a9-9030-228d20d77086 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:08.128760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ee61a13b-3f63-42a9-9030-228d20d77086 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:08.129286 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:08.129888 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:08.135046 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ee61a13b-3f63-42a9-9030-228d20d77086 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:08.135612 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ee61a13b-3f63-42a9-9030-228d20d77086 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:08.136366 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ee61a13b-3f63-42a9-9030-228d20d77086 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:08.136654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:08.136792 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ee61a13b-3f63-42a9-9030-228d20d77086 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:08.137080 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:08.137863 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:08.138287 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:08.328285 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ee61a13b-3f63-42a9-9030-228d20d77086 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:08.331167 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:08.336698 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ee61a13b-3f63-42a9-9030-228d20d77086 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.212511 Jun 29 08:36:08.337282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 73/149] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:08 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:08.342533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:08.345189 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:08.346910 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-104a85f6-5507-44aa-a26f-db4d3270b6e6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.221297 Jun 29 08:36:08.347695 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 77/150] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:08 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:08.649946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a95e4238-1457-4337-9278-4f8f4ad280df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:08.651089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a95e4238-1457-4337-9278-4f8f4ad280df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:08.651490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1f5e42f4-534d-4f7d-9895-a6221bf2ed8f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:08.652112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1f5e42f4-534d-4f7d-9895-a6221bf2ed8f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:08.657650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a95e4238-1457-4337-9278-4f8f4ad280df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:08.658087 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a95e4238-1457-4337-9278-4f8f4ad280df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:08.658413 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f5e42f4-534d-4f7d-9895-a6221bf2ed8f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:08.658890 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f5e42f4-534d-4f7d-9895-a6221bf2ed8f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:08.659023 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a95e4238-1457-4337-9278-4f8f4ad280df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:08.659423 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a95e4238-1457-4337-9278-4f8f4ad280df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:08.659641 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f5e42f4-534d-4f7d-9895-a6221bf2ed8f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:08.660063 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f5e42f4-534d-4f7d-9895-a6221bf2ed8f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:08.679128 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:08.854604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a95e4238-1457-4337-9278-4f8f4ad280df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:08.856931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1f5e42f4-534d-4f7d-9895-a6221bf2ed8f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:08.862707 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a95e4238-1457-4337-9278-4f8f4ad280df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.219522 Jun 29 08:36:08.863330 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 74/151] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:08 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:08.864580 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1f5e42f4-534d-4f7d-9895-a6221bf2ed8f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.219290 Jun 29 08:36:08.866738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 78/152] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:08 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:09.362386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cf0c2271-ab47-4907-a1e5-9c0dad84a004 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:09.363425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cf0c2271-ab47-4907-a1e5-9c0dad84a004 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:09.372003 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:09.372607 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:09.372830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf0c2271-ab47-4907-a1e5-9c0dad84a004 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:09.373271 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf0c2271-ab47-4907-a1e5-9c0dad84a004 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:09.374043 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf0c2271-ab47-4907-a1e5-9c0dad84a004 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:09.374451 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf0c2271-ab47-4907-a1e5-9c0dad84a004 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:09.378678 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:09.379148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:09.379881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:09.380302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:09.572406 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cf0c2271-ab47-4907-a1e5-9c0dad84a004 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:09.577338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:09.580189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cf0c2271-ab47-4907-a1e5-9c0dad84a004 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.224281 Jun 29 08:36:09.580780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 75/153] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:09 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:09.585475 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:09.586986 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:09.588081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-23b91e34-9ae7-419d-9b39-588e92cfdcb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.221615 Jun 29 08:36:09.588691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 79/154] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:09 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:09.881494 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5b5f3e73-d2d6-4cab-ba42-acf2dfc328dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:09.882319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5b5f3e73-d2d6-4cab-ba42-acf2dfc328dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:09.883693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a50a0b09-c0bc-4e95-a3c6-549c306d8a81 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:09.884469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a50a0b09-c0bc-4e95-a3c6-549c306d8a81 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:09.890045 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b5f3e73-d2d6-4cab-ba42-acf2dfc328dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:09.890504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b5f3e73-d2d6-4cab-ba42-acf2dfc328dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:09.891278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a50a0b09-c0bc-4e95-a3c6-549c306d8a81 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:09.891419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b5f3e73-d2d6-4cab-ba42-acf2dfc328dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:09.891709 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a50a0b09-c0bc-4e95-a3c6-549c306d8a81 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:09.891809 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b5f3e73-d2d6-4cab-ba42-acf2dfc328dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:09.892471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a50a0b09-c0bc-4e95-a3c6-549c306d8a81 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:09.892895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a50a0b09-c0bc-4e95-a3c6-549c306d8a81 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:10.111593 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5b5f3e73-d2d6-4cab-ba42-acf2dfc328dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:10.115117 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:10.119214 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a50a0b09-c0bc-4e95-a3c6-549c306d8a81 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:10.119677 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5b5f3e73-d2d6-4cab-ba42-acf2dfc328dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.244003 Jun 29 08:36:10.120267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 76/155] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:09 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:10.127399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a50a0b09-c0bc-4e95-a3c6-549c306d8a81 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.249515 Jun 29 08:36:10.127962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 80/156] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:09 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:10.597847 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5109ba19-986e-4273-aab7-e8945c61a10c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:10.598459 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5109ba19-986e-4273-aab7-e8945c61a10c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:10.605501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:10.605982 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5109ba19-986e-4273-aab7-e8945c61a10c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:10.606161 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5109ba19-986e-4273-aab7-e8945c61a10c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:10.606745 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:10.606943 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5109ba19-986e-4273-aab7-e8945c61a10c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:10.607385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5109ba19-986e-4273-aab7-e8945c61a10c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:10.613271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:10.613686 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:10.614659 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:10.615106 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:10.800452 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5109ba19-986e-4273-aab7-e8945c61a10c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:10.804307 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:10.810330 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5109ba19-986e-4273-aab7-e8945c61a10c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.216578 Jun 29 08:36:10.811151 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 77/157] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:10 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:10.813481 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:10.814977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:10.816295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ba0487a8-497d-4ae3-8245-c24647d8fc48 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.214785 Jun 29 08:36:10.816845 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 81/158] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:10 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:11.136533 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-af3c9013-f506-4692-bbed-6ad9142919a8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:11.137146 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-af3c9013-f506-4692-bbed-6ad9142919a8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:11.143925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-af3c9013-f506-4692-bbed-6ad9142919a8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:11.144360 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-af3c9013-f506-4692-bbed-6ad9142919a8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:11.144487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d108a3f0-77fe-4e7e-92f7-f2d9f3aa94a1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:11.145117 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-af3c9013-f506-4692-bbed-6ad9142919a8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:11.145245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d108a3f0-77fe-4e7e-92f7-f2d9f3aa94a1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:11.145590 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-af3c9013-f506-4692-bbed-6ad9142919a8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:11.161952 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d108a3f0-77fe-4e7e-92f7-f2d9f3aa94a1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:11.162474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d108a3f0-77fe-4e7e-92f7-f2d9f3aa94a1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:11.163308 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d108a3f0-77fe-4e7e-92f7-f2d9f3aa94a1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:11.163723 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d108a3f0-77fe-4e7e-92f7-f2d9f3aa94a1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:11.338727 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-af3c9013-f506-4692-bbed-6ad9142919a8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:11.343235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d108a3f0-77fe-4e7e-92f7-f2d9f3aa94a1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:11.346668 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-af3c9013-f506-4692-bbed-6ad9142919a8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.214025 Jun 29 08:36:11.347321 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 78/159] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:11 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:11.350936 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d108a3f0-77fe-4e7e-92f7-f2d9f3aa94a1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.210322 Jun 29 08:36:11.351502 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 82/160] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:11 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:11.827911 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-541c63d9-8747-4fa8-a4a9-d4b97685e45d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:11.828474 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-541c63d9-8747-4fa8-a4a9-d4b97685e45d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:11.834604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:11.835087 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-541c63d9-8747-4fa8-a4a9-d4b97685e45d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:11.835231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:11.835598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-541c63d9-8747-4fa8-a4a9-d4b97685e45d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:11.836361 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-541c63d9-8747-4fa8-a4a9-d4b97685e45d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:11.836785 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-541c63d9-8747-4fa8-a4a9-d4b97685e45d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:11.842030 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:11.842490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:11.843280 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:11.843708 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:12.207436 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-541c63d9-8747-4fa8-a4a9-d4b97685e45d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:12.209933 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:12.215789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-541c63d9-8747-4fa8-a4a9-d4b97685e45d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.391882 Jun 29 08:36:12.216383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 79/161] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:11 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:12.219093 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:12.220595 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:12.221700 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bbdd38e9-f814-4ce9-b85a-e52dd72e75f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.391532 Jun 29 08:36:12.222230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 83/162] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:11 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:12.371510 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e9440080-e9ef-46ff-807b-56a1874cd6cc tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:12.372104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e9440080-e9ef-46ff-807b-56a1874cd6cc tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:12.374133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c22a5c49-7f09-4d5b-9b51-3b3198481b3b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:12.375195 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c22a5c49-7f09-4d5b-9b51-3b3198481b3b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:12.378497 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9440080-e9ef-46ff-807b-56a1874cd6cc tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:12.378964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9440080-e9ef-46ff-807b-56a1874cd6cc tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:12.379718 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9440080-e9ef-46ff-807b-56a1874cd6cc tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:12.380141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9440080-e9ef-46ff-807b-56a1874cd6cc tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:12.381113 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c22a5c49-7f09-4d5b-9b51-3b3198481b3b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:12.381547 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c22a5c49-7f09-4d5b-9b51-3b3198481b3b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:12.382314 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c22a5c49-7f09-4d5b-9b51-3b3198481b3b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:12.382721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c22a5c49-7f09-4d5b-9b51-3b3198481b3b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:12.570531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e9440080-e9ef-46ff-807b-56a1874cd6cc tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:12.573904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c22a5c49-7f09-4d5b-9b51-3b3198481b3b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:12.579220 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e9440080-e9ef-46ff-807b-56a1874cd6cc tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.213334 Jun 29 08:36:12.579845 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 84/163] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:12 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:12.581359 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c22a5c49-7f09-4d5b-9b51-3b3198481b3b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.221035 Jun 29 08:36:12.581885 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 80/164] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:12 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:13.233520 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-899aa520-7abd-4c2b-be6b-fab8bc17b4fe tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:13.234195 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-899aa520-7abd-4c2b-be6b-fab8bc17b4fe tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:13.240900 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-899aa520-7abd-4c2b-be6b-fab8bc17b4fe tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:13.241335 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-899aa520-7abd-4c2b-be6b-fab8bc17b4fe tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:13.242093 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-899aa520-7abd-4c2b-be6b-fab8bc17b4fe tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:13.242526 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-899aa520-7abd-4c2b-be6b-fab8bc17b4fe tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:13.243870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:13.244454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:13.251101 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:13.251558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:13.252316 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:13.252804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:13.439404 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-899aa520-7abd-4c2b-be6b-fab8bc17b4fe tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:13.442488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:13.447176 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-899aa520-7abd-4c2b-be6b-fab8bc17b4fe tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.217653 Jun 29 08:36:13.447746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 85/165] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:13 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:13.451433 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:13.452944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:13.454070 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d5aa65a5-4433-4d69-b0d3-83747c9573bf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.214362 Jun 29 08:36:13.454743 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 81/166] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:13 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:13.601060 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-981f86d7-4d86-4b11-b85d-36208668736b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:13.602038 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-981f86d7-4d86-4b11-b85d-36208668736b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:13.603554 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2d2ecab7-a0dd-4b9d-8534-d34300b4c2fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:13.604578 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2d2ecab7-a0dd-4b9d-8534-d34300b4c2fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:13.609799 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-981f86d7-4d86-4b11-b85d-36208668736b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:13.610239 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-981f86d7-4d86-4b11-b85d-36208668736b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:13.611032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-981f86d7-4d86-4b11-b85d-36208668736b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:13.611164 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2d2ecab7-a0dd-4b9d-8534-d34300b4c2fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:13.611461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-981f86d7-4d86-4b11-b85d-36208668736b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:13.611609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2d2ecab7-a0dd-4b9d-8534-d34300b4c2fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:13.612227 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2d2ecab7-a0dd-4b9d-8534-d34300b4c2fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:13.612650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2d2ecab7-a0dd-4b9d-8534-d34300b4c2fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:13.801827 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-981f86d7-4d86-4b11-b85d-36208668736b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:13.804818 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2d2ecab7-a0dd-4b9d-8534-d34300b4c2fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:13.809674 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-981f86d7-4d86-4b11-b85d-36208668736b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.215123 Jun 29 08:36:13.810237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 86/167] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:13 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:13.812391 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2d2ecab7-a0dd-4b9d-8534-d34300b4c2fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.215358 Jun 29 08:36:13.813024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 82/168] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:13 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:14.469915 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d10d448f-d136-4edf-a7c3-2759581342aa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:14.470482 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d10d448f-d136-4edf-a7c3-2759581342aa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:14.471992 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:14.472585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:14.477369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d10d448f-d136-4edf-a7c3-2759581342aa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:14.477805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d10d448f-d136-4edf-a7c3-2759581342aa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:14.478571 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d10d448f-d136-4edf-a7c3-2759581342aa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:14.478870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:14.479005 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d10d448f-d136-4edf-a7c3-2759581342aa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:14.479310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:14.480064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:14.480523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:14.668389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d10d448f-d136-4edf-a7c3-2759581342aa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:14.671039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:14.676426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d10d448f-d136-4edf-a7c3-2759581342aa tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.210558 Jun 29 08:36:14.677027 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 87/169] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:14 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:14.679309 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:14.680875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:14.682042 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dbd0e5e8-3302-49e6-a30d-ce5c3a60791f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.213951 Jun 29 08:36:14.682657 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 83/170] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:14 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:14.828295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a3b92e0b-569a-4393-9c14-8c2eb0e29b1c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:14.829080 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a3b92e0b-569a-4393-9c14-8c2eb0e29b1c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:14.829714 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2886716b-be11-4ff2-8b4d-3ac2b3daf55f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:14.830344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2886716b-be11-4ff2-8b4d-3ac2b3daf55f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:14.836324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3b92e0b-569a-4393-9c14-8c2eb0e29b1c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:14.836751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2886716b-be11-4ff2-8b4d-3ac2b3daf55f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:14.836950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3b92e0b-569a-4393-9c14-8c2eb0e29b1c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:14.837368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2886716b-be11-4ff2-8b4d-3ac2b3daf55f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:14.837876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3b92e0b-569a-4393-9c14-8c2eb0e29b1c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:14.838103 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2886716b-be11-4ff2-8b4d-3ac2b3daf55f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:14.838444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3b92e0b-569a-4393-9c14-8c2eb0e29b1c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:14.838587 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2886716b-be11-4ff2-8b4d-3ac2b3daf55f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:15.029669 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2886716b-be11-4ff2-8b4d-3ac2b3daf55f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:15.033210 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a3b92e0b-569a-4393-9c14-8c2eb0e29b1c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:15.037365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2886716b-be11-4ff2-8b4d-3ac2b3daf55f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.211462 Jun 29 08:36:15.037931 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 84/171] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:14 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:15.041125 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a3b92e0b-569a-4393-9c14-8c2eb0e29b1c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.217055 Jun 29 08:36:15.041653 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 88/172] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:14 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:15.698580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2a7bc5b0-cc59-4339-8f56-d0f58f810b79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:15.699711 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2a7bc5b0-cc59-4339-8f56-d0f58f810b79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:15.706199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2a7bc5b0-cc59-4339-8f56-d0f58f810b79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:15.706638 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2a7bc5b0-cc59-4339-8f56-d0f58f810b79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:15.707424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2a7bc5b0-cc59-4339-8f56-d0f58f810b79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:15.707848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2a7bc5b0-cc59-4339-8f56-d0f58f810b79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:15.708149 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:15.708749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:15.715612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:15.716049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:15.716801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:15.717227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:15.907913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2a7bc5b0-cc59-4339-8f56-d0f58f810b79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:15.911934 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:15.915275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2a7bc5b0-cc59-4339-8f56-d0f58f810b79 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.223907 Jun 29 08:36:15.915836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 85/173] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:15 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:15.920352 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:15.921844 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:15.922989 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b95c6faf-52e4-4d20-a2f2-c3ccfbce6dc1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.218670 Jun 29 08:36:15.923539 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 89/174] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:15 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:16.054231 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-76a0645f-7829-4bb2-b0c4-c6d2cb50f267 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:16.054856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-76a0645f-7829-4bb2-b0c4-c6d2cb50f267 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:16.057217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6cdb0931-0bab-425b-a48f-b60e907fc0c4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:16.057861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6cdb0931-0bab-425b-a48f-b60e907fc0c4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:16.061266 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-76a0645f-7829-4bb2-b0c4-c6d2cb50f267 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:16.061706 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-76a0645f-7829-4bb2-b0c4-c6d2cb50f267 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:16.062488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-76a0645f-7829-4bb2-b0c4-c6d2cb50f267 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:16.062930 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-76a0645f-7829-4bb2-b0c4-c6d2cb50f267 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:16.063967 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6cdb0931-0bab-425b-a48f-b60e907fc0c4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:16.064407 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6cdb0931-0bab-425b-a48f-b60e907fc0c4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:16.065148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6cdb0931-0bab-425b-a48f-b60e907fc0c4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:16.065574 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6cdb0931-0bab-425b-a48f-b60e907fc0c4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:16.259030 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-76a0645f-7829-4bb2-b0c4-c6d2cb50f267 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:16.265159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6cdb0931-0bab-425b-a48f-b60e907fc0c4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:16.266876 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-76a0645f-7829-4bb2-b0c4-c6d2cb50f267 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.216424 Jun 29 08:36:16.267456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 86/175] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:16 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:16.277227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6cdb0931-0bab-425b-a48f-b60e907fc0c4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.223777 Jun 29 08:36:16.277905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 90/176] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:16 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:16.935550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8200cdae-712d-4352-9338-b7001a55bec8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:16.936171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8200cdae-712d-4352-9338-b7001a55bec8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:16.940983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:16.941583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:16.942315 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8200cdae-712d-4352-9338-b7001a55bec8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:16.942793 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8200cdae-712d-4352-9338-b7001a55bec8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:16.943539 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8200cdae-712d-4352-9338-b7001a55bec8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:16.943956 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8200cdae-712d-4352-9338-b7001a55bec8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:16.947761 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:16.948245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:16.949126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:16.949698 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:17.134019 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8200cdae-712d-4352-9338-b7001a55bec8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:17.138621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:17.142863 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8200cdae-712d-4352-9338-b7001a55bec8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.213450 Jun 29 08:36:17.143410 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 87/177] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:16 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:17.146825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:17.148371 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:17.149563 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4b25bd48-3244-4680-9b09-99644b48bdf3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.212515 Jun 29 08:36:17.150121 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 91/178] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:16 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:17.284073 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-23276a1c-fb47-4609-b332-a81a8acf14e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:17.284787 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-23276a1c-fb47-4609-b332-a81a8acf14e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:17.291458 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23276a1c-fb47-4609-b332-a81a8acf14e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:17.292170 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23276a1c-fb47-4609-b332-a81a8acf14e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:17.292920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23276a1c-fb47-4609-b332-a81a8acf14e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:17.293424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23276a1c-fb47-4609-b332-a81a8acf14e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:17.294547 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-794bbed1-6470-4212-a8e9-3a5f8efc072b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:17.295185 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-794bbed1-6470-4212-a8e9-3a5f8efc072b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:17.301602 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-794bbed1-6470-4212-a8e9-3a5f8efc072b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:17.302042 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-794bbed1-6470-4212-a8e9-3a5f8efc072b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:17.302889 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-794bbed1-6470-4212-a8e9-3a5f8efc072b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:17.303314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-794bbed1-6470-4212-a8e9-3a5f8efc072b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:17.489242 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-23276a1c-fb47-4609-b332-a81a8acf14e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:17.493284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-794bbed1-6470-4212-a8e9-3a5f8efc072b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:17.497169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-23276a1c-fb47-4609-b332-a81a8acf14e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.216802 Jun 29 08:36:17.497751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 88/179] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:17 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:17.501326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-794bbed1-6470-4212-a8e9-3a5f8efc072b tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.210893 Jun 29 08:36:17.501993 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 92/180] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:17 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:18.160403 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-64b7d52d-4756-4990-bd2c-db5645176ac4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:18.161681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-64b7d52d-4756-4990-bd2c-db5645176ac4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:18.167392 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:18.167976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:18.168279 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-64b7d52d-4756-4990-bd2c-db5645176ac4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:18.168746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-64b7d52d-4756-4990-bd2c-db5645176ac4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:18.169685 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-64b7d52d-4756-4990-bd2c-db5645176ac4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:18.170185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-64b7d52d-4756-4990-bd2c-db5645176ac4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:18.175681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:18.176087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:18.176891 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:18.177308 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:18.369530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-64b7d52d-4756-4990-bd2c-db5645176ac4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:18.373369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:18.377351 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-64b7d52d-4756-4990-bd2c-db5645176ac4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.220922 Jun 29 08:36:18.379063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 89/181] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:18 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:18.381902 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:18.384448 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:18.384554 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f77dd58e-2cc8-48b5-9af5-521673b912a3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.221215 Jun 29 08:36:18.391314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 93/182] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:18 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:18.513567 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c3ec5053-d72e-4c22-8c5f-d70e889cfda7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:18.514143 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c3ec5053-d72e-4c22-8c5f-d70e889cfda7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:18.517152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-928c1553-fc47-4e1c-82fc-de8085ab8432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:18.517759 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-928c1553-fc47-4e1c-82fc-de8085ab8432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:18.522877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c3ec5053-d72e-4c22-8c5f-d70e889cfda7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:18.522877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c3ec5053-d72e-4c22-8c5f-d70e889cfda7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:18.522877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c3ec5053-d72e-4c22-8c5f-d70e889cfda7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:18.523108 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c3ec5053-d72e-4c22-8c5f-d70e889cfda7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:18.523897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-928c1553-fc47-4e1c-82fc-de8085ab8432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:18.524331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-928c1553-fc47-4e1c-82fc-de8085ab8432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:18.525077 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-928c1553-fc47-4e1c-82fc-de8085ab8432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:18.525491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-928c1553-fc47-4e1c-82fc-de8085ab8432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:18.716262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c3ec5053-d72e-4c22-8c5f-d70e889cfda7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:18.719231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-928c1553-fc47-4e1c-82fc-de8085ab8432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:18.723975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c3ec5053-d72e-4c22-8c5f-d70e889cfda7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.214518 Jun 29 08:36:18.724552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 90/183] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:18 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:18.727833 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-928c1553-fc47-4e1c-82fc-de8085ab8432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.214235 Jun 29 08:36:18.728657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 94/184] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:18 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:19.398157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e76189b0-486b-4f9e-9d58-b662b20c832f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:19.399146 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e76189b0-486b-4f9e-9d58-b662b20c832f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:19.405569 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:19.406568 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:19.412031 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e76189b0-486b-4f9e-9d58-b662b20c832f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:19.412750 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e76189b0-486b-4f9e-9d58-b662b20c832f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:19.414106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e76189b0-486b-4f9e-9d58-b662b20c832f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:19.414745 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e76189b0-486b-4f9e-9d58-b662b20c832f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:19.416906 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:19.417685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:19.419608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:19.420068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:19.424337 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:19.618665 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e76189b0-486b-4f9e-9d58-b662b20c832f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:19.621989 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:19.626635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e76189b0-486b-4f9e-9d58-b662b20c832f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.234821 Jun 29 08:36:19.627266 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 91/185] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:19 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:19.630375 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:19.631891 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:19.633043 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fde77d80-29db-42ce-89fd-7dea9d1c6e8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.234401 Jun 29 08:36:19.633621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 95/186] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:19 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:19.748004 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-66ec46f4-3174-4f31-9bfd-e7e16cb42748 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:19.748404 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-225285ac-efc0-4e98-af4b-f803cb1cdfb9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:19.748552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-66ec46f4-3174-4f31-9bfd-e7e16cb42748 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:19.749003 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-225285ac-efc0-4e98-af4b-f803cb1cdfb9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:19.755170 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66ec46f4-3174-4f31-9bfd-e7e16cb42748 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:19.755355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-225285ac-efc0-4e98-af4b-f803cb1cdfb9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:19.755710 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-225285ac-efc0-4e98-af4b-f803cb1cdfb9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:19.755853 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66ec46f4-3174-4f31-9bfd-e7e16cb42748 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:19.756446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-225285ac-efc0-4e98-af4b-f803cb1cdfb9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:19.756730 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66ec46f4-3174-4f31-9bfd-e7e16cb42748 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:19.756876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-225285ac-efc0-4e98-af4b-f803cb1cdfb9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:19.757165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66ec46f4-3174-4f31-9bfd-e7e16cb42748 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:19.957348 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-225285ac-efc0-4e98-af4b-f803cb1cdfb9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:19.965497 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-66ec46f4-3174-4f31-9bfd-e7e16cb42748 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:19.966917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-225285ac-efc0-4e98-af4b-f803cb1cdfb9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.223815 Jun 29 08:36:19.968017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 96/187] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:19 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:19.974291 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-66ec46f4-3174-4f31-9bfd-e7e16cb42748 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.232883 Jun 29 08:36:19.975183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 92/188] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:19 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:20.643771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9a9ee42a-1e1d-473b-b007-d3be903dc74e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:20.644494 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9a9ee42a-1e1d-473b-b007-d3be903dc74e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:20.651368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9a9ee42a-1e1d-473b-b007-d3be903dc74e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:20.651956 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9a9ee42a-1e1d-473b-b007-d3be903dc74e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:20.652924 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9a9ee42a-1e1d-473b-b007-d3be903dc74e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:20.653220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9a9ee42a-1e1d-473b-b007-d3be903dc74e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:20.674039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:20.690969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-e18b183d-baf2-4881-8feb-521a3dbd54ab req-f98ca313-1754-4eea-9ba3-ae712247f283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e23553-4467-4f79-969b-21758f4c244a", "name": "network-vif-plugged", "status": "completed", "tag": "13059f8a-34b7-4a4a-a56b-e4bfe5599234"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:36:20.699774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e18b183d-baf2-4881-8feb-521a3dbd54ab req-f98ca313-1754-4eea-9ba3-ae712247f283 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:20.700237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e18b183d-baf2-4881-8feb-521a3dbd54ab req-f98ca313-1754-4eea-9ba3-ae712247f283 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:20.711257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-e18b183d-baf2-4881-8feb-521a3dbd54ab req-f98ca313-1754-4eea-9ba3-ae712247f283 service nova] Creating event network-vif-plugged:13059f8a-34b7-4a4a-a56b-e4bfe5599234 for instance 92e23553-4467-4f79-969b-21758f4c244a on hv-cinder-79760 Jun 29 08:36:20.716711 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-e18b183d-baf2-4881-8feb-521a3dbd54ab req-f98ca313-1754-4eea-9ba3-ae712247f283 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088223 Jun 29 08:36:20.717268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 97/189] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:36:20.722234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:20.722956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:20.729096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:20.729540 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:20.730288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:20.730740 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:20.812662 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9a9ee42a-1e1d-473b-b007-d3be903dc74e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:20.820975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9a9ee42a-1e1d-473b-b007-d3be903dc74e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.180981 Jun 29 08:36:20.821554 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 93/190] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:20 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:20.878632 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:20.886949 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:20.888547 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:20.889630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-698992ce-2dbf-40ca-8561-38c3fb7fbb3d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.171288 Jun 29 08:36:20.890187 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 98/191] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:20 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:20.985187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a7597e8b-2cfd-469a-94f3-0b7f295303c8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:20.986877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a7597e8b-2cfd-469a-94f3-0b7f295303c8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:20.991831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-975fb670-2386-460a-8c97-8152f06bf65f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:20.992426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-975fb670-2386-460a-8c97-8152f06bf65f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:20.992588 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a7597e8b-2cfd-469a-94f3-0b7f295303c8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:20.993032 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a7597e8b-2cfd-469a-94f3-0b7f295303c8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:20.993784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a7597e8b-2cfd-469a-94f3-0b7f295303c8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:20.994183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a7597e8b-2cfd-469a-94f3-0b7f295303c8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:20.999333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-975fb670-2386-460a-8c97-8152f06bf65f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:20.999737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-975fb670-2386-460a-8c97-8152f06bf65f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:21.000689 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-975fb670-2386-460a-8c97-8152f06bf65f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:21.001184 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-975fb670-2386-460a-8c97-8152f06bf65f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:21.188031 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a7597e8b-2cfd-469a-94f3-0b7f295303c8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:21.195283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-975fb670-2386-460a-8c97-8152f06bf65f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:21.195979 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a7597e8b-2cfd-469a-94f3-0b7f295303c8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.215324 Jun 29 08:36:21.196881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 94/192] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:20 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:21.203151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-975fb670-2386-460a-8c97-8152f06bf65f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.215034 Jun 29 08:36:21.212765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 99/193] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:20 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:21.837463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e5e97e3b-2b0c-4618-baa6-1e2bddce8601 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:21.838281 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e5e97e3b-2b0c-4618-baa6-1e2bddce8601 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:21.845063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e5e97e3b-2b0c-4618-baa6-1e2bddce8601 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:21.845736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e5e97e3b-2b0c-4618-baa6-1e2bddce8601 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:21.846967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e5e97e3b-2b0c-4618-baa6-1e2bddce8601 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:21.847385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e5e97e3b-2b0c-4618-baa6-1e2bddce8601 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:21.909081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:21.909845 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:21.916771 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:21.917222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:21.917994 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:21.918425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:22.031150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e5e97e3b-2b0c-4618-baa6-1e2bddce8601 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:22.040388 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e5e97e3b-2b0c-4618-baa6-1e2bddce8601 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.206653 Jun 29 08:36:22.040897 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 95/194] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:21 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:22.082323 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:22.091825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:22.093328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:22.094435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-55da3236-e7b1-4833-a798-5a28062b135b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.190845 Jun 29 08:36:22.095019 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 100/195] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:21 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:36:22.216606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-12bfc39e-cba5-4e55-8f8d-5397afdd0ea4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:22.217203 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-12bfc39e-cba5-4e55-8f8d-5397afdd0ea4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:22.221495 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7582e112-d2d2-4e71-98a0-6ef9bd393e2f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:22.222260 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7582e112-d2d2-4e71-98a0-6ef9bd393e2f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:22.223944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12bfc39e-cba5-4e55-8f8d-5397afdd0ea4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:22.224395 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12bfc39e-cba5-4e55-8f8d-5397afdd0ea4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:22.225152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12bfc39e-cba5-4e55-8f8d-5397afdd0ea4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:22.225555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12bfc39e-cba5-4e55-8f8d-5397afdd0ea4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:22.229268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7582e112-d2d2-4e71-98a0-6ef9bd393e2f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:22.229707 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7582e112-d2d2-4e71-98a0-6ef9bd393e2f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:22.230458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7582e112-d2d2-4e71-98a0-6ef9bd393e2f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:22.230921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7582e112-d2d2-4e71-98a0-6ef9bd393e2f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:22.418815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-12bfc39e-cba5-4e55-8f8d-5397afdd0ea4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:22.427061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-12bfc39e-cba5-4e55-8f8d-5397afdd0ea4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.216591 Jun 29 08:36:22.427643 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 96/196] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:22 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:22.428208 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7582e112-d2d2-4e71-98a0-6ef9bd393e2f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:22.436220 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7582e112-d2d2-4e71-98a0-6ef9bd393e2f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.219115 Jun 29 08:36:22.436811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 101/197] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:22 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:23.062364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-336a05ac-5414-4064-8d42-025de0e9a0fc tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:23.064770 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-336a05ac-5414-4064-8d42-025de0e9a0fc tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:23.079858 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-336a05ac-5414-4064-8d42-025de0e9a0fc tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:23.080651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-336a05ac-5414-4064-8d42-025de0e9a0fc tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:23.082338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-336a05ac-5414-4064-8d42-025de0e9a0fc tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:23.083504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-336a05ac-5414-4064-8d42-025de0e9a0fc tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:23.113279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:23.114734 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:23.126431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:23.127245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:23.128205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:23.128761 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:23.403055 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-336a05ac-5414-4064-8d42-025de0e9a0fc tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:23.413284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-336a05ac-5414-4064-8d42-025de0e9a0fc tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.359141 Jun 29 08:36:23.414664 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 97/198] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:23 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:23.431450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:23.446021 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:23.452141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-57abe37a-f4fb-48e5-b8fb-51c4ed06dbaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:23.456619 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:23.457441 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-57abe37a-f4fb-48e5-b8fb-51c4ed06dbaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:23.458026 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cc6f0f54-452f-425f-9631-7ec0722c50bb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.350373 Jun 29 08:36:23.463755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 102/199] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:23 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:36:23.476189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57abe37a-f4fb-48e5-b8fb-51c4ed06dbaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:23.477470 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57abe37a-f4fb-48e5-b8fb-51c4ed06dbaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:23.477595 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9cf542b3-d5ba-4459-98e3-a88b95396708 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:23.478084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9cf542b3-d5ba-4459-98e3-a88b95396708 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:23.478904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57abe37a-f4fb-48e5-b8fb-51c4ed06dbaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:23.479557 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57abe37a-f4fb-48e5-b8fb-51c4ed06dbaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:23.502092 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9cf542b3-d5ba-4459-98e3-a88b95396708 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:23.503083 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9cf542b3-d5ba-4459-98e3-a88b95396708 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:23.508825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9cf542b3-d5ba-4459-98e3-a88b95396708 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:23.510078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9cf542b3-d5ba-4459-98e3-a88b95396708 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:23.835967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-57abe37a-f4fb-48e5-b8fb-51c4ed06dbaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:23.844814 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-57abe37a-f4fb-48e5-b8fb-51c4ed06dbaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.400013 Jun 29 08:36:23.851726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 98/200] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:23 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:23.856086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9cf542b3-d5ba-4459-98e3-a88b95396708 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:23.864731 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9cf542b3-d5ba-4459-98e3-a88b95396708 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.398594 Jun 29 08:36:23.865042 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 103/201] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:23 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:24.430736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b7df060a-5d3a-4c76-9880-69a0e3669c20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:24.431365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b7df060a-5d3a-4c76-9880-69a0e3669c20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:24.437788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b7df060a-5d3a-4c76-9880-69a0e3669c20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.438223 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b7df060a-5d3a-4c76-9880-69a0e3669c20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:24.439058 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b7df060a-5d3a-4c76-9880-69a0e3669c20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.439481 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b7df060a-5d3a-4c76-9880-69a0e3669c20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:24.478707 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:24.479391 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:24.486789 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.487397 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:24.488342 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.488937 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:24.835625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b7df060a-5d3a-4c76-9880-69a0e3669c20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:24.846388 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b7df060a-5d3a-4c76-9880-69a0e3669c20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.419419 Jun 29 08:36:24.850744 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 99/202] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:24 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:24.860435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-c71e92a1-c523-4a7c-89bd-25d67a26ae2f req-bd4ec62c-21f5-4573-a22f-2f6352738da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f7924b-e691-4d2b-8ea7-a4438a64d3b8", "name": "network-vif-plugged", "status": "completed", "tag": "71f36781-07b8-496d-a3d0-c0d224617705"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:36:24.881044 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-c71e92a1-c523-4a7c-89bd-25d67a26ae2f req-bd4ec62c-21f5-4573-a22f-2f6352738da0 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.881515 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-c71e92a1-c523-4a7c-89bd-25d67a26ae2f req-bd4ec62c-21f5-4573-a22f-2f6352738da0 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:24.893922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-c71e92a1-c523-4a7c-89bd-25d67a26ae2f req-bd4ec62c-21f5-4573-a22f-2f6352738da0 service nova] Creating event network-vif-plugged:71f36781-07b8-496d-a3d0-c0d224617705 for instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 on hv-cinder-79760 Jun 29 08:36:24.897726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:24.914083 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:24.918222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:24.919247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-c71e92a1-c523-4a7c-89bd-25d67a26ae2f req-bd4ec62c-21f5-4573-a22f-2f6352738da0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065437 Jun 29 08:36:24.921762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-24ed6c7a-d996-42c6-a4bf-20e9617a2ab7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.448167 Jun 29 08:36:24.923939 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 100/203] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:36:24.926553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 104/204] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:24 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:24.939543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-63918f79-1654-4c11-a4ea-4533f76334a5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:24.944906 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8246f9d9-bb7b-4a16-b748-3881b955b9d0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:24.945560 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8246f9d9-bb7b-4a16-b748-3881b955b9d0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:24.956328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-63918f79-1654-4c11-a4ea-4533f76334a5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:24.973780 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-63918f79-1654-4c11-a4ea-4533f76334a5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.975804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8246f9d9-bb7b-4a16-b748-3881b955b9d0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.976227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-63918f79-1654-4c11-a4ea-4533f76334a5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:24.976973 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-63918f79-1654-4c11-a4ea-4533f76334a5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.977397 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-63918f79-1654-4c11-a4ea-4533f76334a5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:24.978432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8246f9d9-bb7b-4a16-b748-3881b955b9d0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:24.979218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8246f9d9-bb7b-4a16-b748-3881b955b9d0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:24.979904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8246f9d9-bb7b-4a16-b748-3881b955b9d0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:25.389443 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8246f9d9-bb7b-4a16-b748-3881b955b9d0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:25.403103 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8246f9d9-bb7b-4a16-b748-3881b955b9d0 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.477725 Jun 29 08:36:25.413260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 101/205] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:24 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:25.431459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-63918f79-1654-4c11-a4ea-4533f76334a5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:25.441904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-63918f79-1654-4c11-a4ea-4533f76334a5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.512645 Jun 29 08:36:25.452904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 105/206] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:24 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:25.884839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1fa20ede-8ee3-4a32-a184-755522f43926 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:25.888665 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1fa20ede-8ee3-4a32-a184-755522f43926 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:25.914132 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1fa20ede-8ee3-4a32-a184-755522f43926 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:25.914681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1fa20ede-8ee3-4a32-a184-755522f43926 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:25.915885 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1fa20ede-8ee3-4a32-a184-755522f43926 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:25.916442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1fa20ede-8ee3-4a32-a184-755522f43926 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:25.944389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:25.945117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:25.955686 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:25.956176 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:25.956961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:25.957375 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:26.239919 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:26.254111 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:26.256059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:26.259124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-81dcf3a6-e9dd-4ea4-9907-36dba170d03d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.319098 Jun 29 08:36:26.266325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 106/207] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:25 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:36:26.279623 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1fa20ede-8ee3-4a32-a184-755522f43926 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:26.290028 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1fa20ede-8ee3-4a32-a184-755522f43926 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.421685 Jun 29 08:36:26.293892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 102/208] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:25 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:26.423533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0de09d06-246f-4cbc-a806-c858cfcd32c5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:26.424313 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0de09d06-246f-4cbc-a806-c858cfcd32c5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:26.435214 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0de09d06-246f-4cbc-a806-c858cfcd32c5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:26.435813 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0de09d06-246f-4cbc-a806-c858cfcd32c5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:26.437302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0de09d06-246f-4cbc-a806-c858cfcd32c5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:26.438134 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0de09d06-246f-4cbc-a806-c858cfcd32c5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:26.483087 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-35c03c40-1de7-45be-a9b5-59f258a3fe49 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:26.484498 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-35c03c40-1de7-45be-a9b5-59f258a3fe49 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:26.506097 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-35c03c40-1de7-45be-a9b5-59f258a3fe49 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:26.506542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-35c03c40-1de7-45be-a9b5-59f258a3fe49 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:26.507342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-35c03c40-1de7-45be-a9b5-59f258a3fe49 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:26.507768 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-35c03c40-1de7-45be-a9b5-59f258a3fe49 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:26.770292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0de09d06-246f-4cbc-a806-c858cfcd32c5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:26.785819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0de09d06-246f-4cbc-a806-c858cfcd32c5 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.368560 Jun 29 08:36:26.797231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 107/209] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:26 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:26.829559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-35c03c40-1de7-45be-a9b5-59f258a3fe49 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:26.840435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-35c03c40-1de7-45be-a9b5-59f258a3fe49 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.372399 Jun 29 08:36:26.840917 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 103/210] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:26 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:27.285341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:27.285964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:27.293253 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:27.293997 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:27.295147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:27.295769 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:27.307534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-68fb12d3-6623-4931-9e03-fb4fd05baf32 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:27.308138 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-68fb12d3-6623-4931-9e03-fb4fd05baf32 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:27.315979 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68fb12d3-6623-4931-9e03-fb4fd05baf32 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:27.316411 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68fb12d3-6623-4931-9e03-fb4fd05baf32 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:27.318717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68fb12d3-6623-4931-9e03-fb4fd05baf32 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:27.319155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68fb12d3-6623-4931-9e03-fb4fd05baf32 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:27.627947 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:27.635486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:27.636968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:27.638105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1cc74271-2eb6-4f3c-a9ea-ddf72dd637d5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.358082 Jun 29 08:36:27.640884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 108/211] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:27 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:27.659551 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-68fb12d3-6623-4931-9e03-fb4fd05baf32 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:27.673590 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-68fb12d3-6623-4931-9e03-fb4fd05baf32 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.369801 Jun 29 08:36:27.674630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 104/212] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:27 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:27.804136 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4b5f76c1-f5e8-4379-b76c-a7746dc55a01 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:27.804889 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4b5f76c1-f5e8-4379-b76c-a7746dc55a01 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:27.811208 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b5f76c1-f5e8-4379-b76c-a7746dc55a01 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:27.811714 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b5f76c1-f5e8-4379-b76c-a7746dc55a01 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:27.812608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b5f76c1-f5e8-4379-b76c-a7746dc55a01 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:27.813184 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b5f76c1-f5e8-4379-b76c-a7746dc55a01 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:27.858393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-57a34538-0235-442b-a20c-3dec8dd67d1f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:27.859510 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-57a34538-0235-442b-a20c-3dec8dd67d1f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:27.869238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57a34538-0235-442b-a20c-3dec8dd67d1f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:27.870116 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57a34538-0235-442b-a20c-3dec8dd67d1f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:27.871301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57a34538-0235-442b-a20c-3dec8dd67d1f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:27.871994 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57a34538-0235-442b-a20c-3dec8dd67d1f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:28.027634 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b5f76c1-f5e8-4379-b76c-a7746dc55a01 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:28.040059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4b5f76c1-f5e8-4379-b76c-a7746dc55a01 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.239745 Jun 29 08:36:28.051467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 109/213] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:27 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:28.053382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-57a34538-0235-442b-a20c-3dec8dd67d1f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:28.061155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-57a34538-0235-442b-a20c-3dec8dd67d1f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.207501 Jun 29 08:36:28.062299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 105/214] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:27 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:28.657556 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:28.658304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:28.666835 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:28.666835 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:28.668965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:28.669468 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:28.692038 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5e69e584-7e12-45f0-9af1-c79a54da9b93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:28.692761 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5e69e584-7e12-45f0-9af1-c79a54da9b93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:28.709522 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5e69e584-7e12-45f0-9af1-c79a54da9b93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:28.720885 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5e69e584-7e12-45f0-9af1-c79a54da9b93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:28.722263 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5e69e584-7e12-45f0-9af1-c79a54da9b93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:28.723416 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5e69e584-7e12-45f0-9af1-c79a54da9b93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:28.877953 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:28.891572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:28.893781 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:28.895313 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6072aa7d-b965-43ea-9446-868908056dd2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.242106 Jun 29 08:36:28.896813 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 110/215] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:28 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:28.992173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5e69e584-7e12-45f0-9af1-c79a54da9b93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:29.001137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5e69e584-7e12-45f0-9af1-c79a54da9b93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.313580 Jun 29 08:36:29.001961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 106/216] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:28 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:29.060136 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fa4f8ea8-2b65-4a6f-bb36-19e305ac3431 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:29.061710 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fa4f8ea8-2b65-4a6f-bb36-19e305ac3431 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:29.069143 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa4f8ea8-2b65-4a6f-bb36-19e305ac3431 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:29.069589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa4f8ea8-2b65-4a6f-bb36-19e305ac3431 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:29.070341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa4f8ea8-2b65-4a6f-bb36-19e305ac3431 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:29.071074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa4f8ea8-2b65-4a6f-bb36-19e305ac3431 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:29.081605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-10b328ad-aa63-43a1-9129-73d3cb99e6a6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:29.082232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-10b328ad-aa63-43a1-9129-73d3cb99e6a6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:29.090843 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-10b328ad-aa63-43a1-9129-73d3cb99e6a6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:29.091562 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-10b328ad-aa63-43a1-9129-73d3cb99e6a6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:29.092513 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-10b328ad-aa63-43a1-9129-73d3cb99e6a6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:29.093145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-10b328ad-aa63-43a1-9129-73d3cb99e6a6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:29.289263 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fa4f8ea8-2b65-4a6f-bb36-19e305ac3431 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:29.298161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fa4f8ea8-2b65-4a6f-bb36-19e305ac3431 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.243973 Jun 29 08:36:29.298841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 111/217] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:29 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:29.308920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-10b328ad-aa63-43a1-9129-73d3cb99e6a6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:29.317893 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-10b328ad-aa63-43a1-9129-73d3cb99e6a6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.244032 Jun 29 08:36:29.318662 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 107/218] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:29 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:29.700393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-5463eb93-89af-44af-a513-7425f9326dbd req-18ca53cb-d99f-4ae8-96a8-cee47dc12521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ff4bf7-d905-4584-98f7-26236c14a7d8", "name": "network-vif-plugged", "status": "completed", "tag": "2ed55c94-eef8-437e-ba0f-2a7792313f0d"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:36:29.710582 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-5463eb93-89af-44af-a513-7425f9326dbd req-18ca53cb-d99f-4ae8-96a8-cee47dc12521 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:29.711113 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-5463eb93-89af-44af-a513-7425f9326dbd req-18ca53cb-d99f-4ae8-96a8-cee47dc12521 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:29.726267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-5463eb93-89af-44af-a513-7425f9326dbd req-18ca53cb-d99f-4ae8-96a8-cee47dc12521 service nova] Creating event network-vif-plugged:2ed55c94-eef8-437e-ba0f-2a7792313f0d for instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 on hv-cinder-79760 Jun 29 08:36:29.733220 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-5463eb93-89af-44af-a513-7425f9326dbd req-18ca53cb-d99f-4ae8-96a8-cee47dc12521 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035996 Jun 29 08:36:29.733508 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 112/219] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:36:29.915750 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:29.916351 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:29.923173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:29.923552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:29.924299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:29.924706 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:30.017998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d3c0b7c1-b058-4add-bfac-f6b795fbce35 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:30.018743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d3c0b7c1-b058-4add-bfac-f6b795fbce35 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:30.025941 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c0b7c1-b058-4add-bfac-f6b795fbce35 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:30.026386 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c0b7c1-b058-4add-bfac-f6b795fbce35 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:30.027171 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c0b7c1-b058-4add-bfac-f6b795fbce35 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:30.027608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c0b7c1-b058-4add-bfac-f6b795fbce35 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:30.032492 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:30.295723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:30.305358 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:30.306866 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:30.307967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-11c2d205-7585-4433-8d18-0558448c16b0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.396267 Jun 29 08:36:30.308822 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 108/220] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:29 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:30.314239 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e36c88c5-a0e0-44fe-86ef-2df49a7ee4bb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:30.315013 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e36c88c5-a0e0-44fe-86ef-2df49a7ee4bb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:30.321035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e36c88c5-a0e0-44fe-86ef-2df49a7ee4bb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:30.321679 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e36c88c5-a0e0-44fe-86ef-2df49a7ee4bb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:30.322398 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e36c88c5-a0e0-44fe-86ef-2df49a7ee4bb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:30.322989 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e36c88c5-a0e0-44fe-86ef-2df49a7ee4bb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:30.351862 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d3c0b7c1-b058-4add-bfac-f6b795fbce35 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:30.359694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d3c0b7c1-b058-4add-bfac-f6b795fbce35 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.345871 Jun 29 08:36:30.368825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 113/221] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:30 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:30.368825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-942991b7-f312-4358-b96e-c54c7f0ab606 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:30.368825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-942991b7-f312-4358-b96e-c54c7f0ab606 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:30.376298 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-942991b7-f312-4358-b96e-c54c7f0ab606 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:30.376933 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-942991b7-f312-4358-b96e-c54c7f0ab606 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:30.378274 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-942991b7-f312-4358-b96e-c54c7f0ab606 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:30.378784 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-942991b7-f312-4358-b96e-c54c7f0ab606 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:30.520185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e36c88c5-a0e0-44fe-86ef-2df49a7ee4bb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:30.534970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e36c88c5-a0e0-44fe-86ef-2df49a7ee4bb tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.224276 Jun 29 08:36:30.535667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 109/222] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:30 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:30.553364 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-942991b7-f312-4358-b96e-c54c7f0ab606 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:30.562444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-942991b7-f312-4358-b96e-c54c7f0ab606 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.200912 Jun 29 08:36:30.577458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 114/223] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:30 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:31.329244 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:31.329874 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:31.336430 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:31.336873 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:31.337633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:31.338056 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:31.376718 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e2b03dd4-aacf-495d-9280-4b583d3a623c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:31.377305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e2b03dd4-aacf-495d-9280-4b583d3a623c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:31.383610 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2b03dd4-aacf-495d-9280-4b583d3a623c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:31.384051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2b03dd4-aacf-495d-9280-4b583d3a623c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:31.384800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2b03dd4-aacf-495d-9280-4b583d3a623c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:31.385229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2b03dd4-aacf-495d-9280-4b583d3a623c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:31.528370 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:31.532089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:31.537733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:31.539185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:31.540288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-55afab3e-4d38-4b32-93dc-36802686814f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.216640 Jun 29 08:36:31.540838 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 110/224] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:31 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:31.555469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e2b03dd4-aacf-495d-9280-4b583d3a623c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:31.555911 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-82c85aaf-7db9-4ea8-a689-f59ff6aaec7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:31.556568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-82c85aaf-7db9-4ea8-a689-f59ff6aaec7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:31.563035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-82c85aaf-7db9-4ea8-a689-f59ff6aaec7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:31.563470 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-82c85aaf-7db9-4ea8-a689-f59ff6aaec7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:31.563567 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e2b03dd4-aacf-495d-9280-4b583d3a623c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.190902 Jun 29 08:36:31.564045 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 115/225] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:31 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:31.564228 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-82c85aaf-7db9-4ea8-a689-f59ff6aaec7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:31.564650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-82c85aaf-7db9-4ea8-a689-f59ff6aaec7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:31.585259 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2ed75a23-9b21-465b-a456-d92a9e0be658 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:31.585895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2ed75a23-9b21-465b-a456-d92a9e0be658 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:31.593171 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ed75a23-9b21-465b-a456-d92a9e0be658 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:31.593775 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ed75a23-9b21-465b-a456-d92a9e0be658 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:31.594537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ed75a23-9b21-465b-a456-d92a9e0be658 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:31.595008 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ed75a23-9b21-465b-a456-d92a9e0be658 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:31.769017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-82c85aaf-7db9-4ea8-a689-f59ff6aaec7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:31.772644 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2ed75a23-9b21-465b-a456-d92a9e0be658 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:31.776732 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-82c85aaf-7db9-4ea8-a689-f59ff6aaec7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.228036 Jun 29 08:36:31.777299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 111/226] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:31 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:31.780326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2ed75a23-9b21-465b-a456-d92a9e0be658 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.198925 Jun 29 08:36:31.780881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 116/227] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:31 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:32.565768 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:32.566326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:32.573465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:32.573906 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:32.574664 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:32.575106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:32.580762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1c9189f4-af22-4ea7-b2df-d59feb5e7a3d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:32.581380 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1c9189f4-af22-4ea7-b2df-d59feb5e7a3d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:32.587921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1c9189f4-af22-4ea7-b2df-d59feb5e7a3d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:32.588626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1c9189f4-af22-4ea7-b2df-d59feb5e7a3d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:32.589386 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1c9189f4-af22-4ea7-b2df-d59feb5e7a3d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:32.590304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1c9189f4-af22-4ea7-b2df-d59feb5e7a3d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:32.792237 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:32.797455 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1c9189f4-af22-4ea7-b2df-d59feb5e7a3d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:32.802328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:32.804068 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:32.805482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-535b2df6-3c1e-4905-b589-8103269d1567 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.250023 Jun 29 08:36:32.805733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1c9189f4-af22-4ea7-b2df-d59feb5e7a3d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.229097 Jun 29 08:36:32.806213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 112/228] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:32 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:32.806620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 117/229] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:32 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:32.814583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dc5e7ba3-7b5e-4a48-8c7b-25a0c0d5aa29 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:32.815426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dc5e7ba3-7b5e-4a48-8c7b-25a0c0d5aa29 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:32.819542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9ca607fb-b46d-4aa9-b79a-1eee8dd100a3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:32.820284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9ca607fb-b46d-4aa9-b79a-1eee8dd100a3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:32.823426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc5e7ba3-7b5e-4a48-8c7b-25a0c0d5aa29 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:32.824162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc5e7ba3-7b5e-4a48-8c7b-25a0c0d5aa29 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:32.824926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc5e7ba3-7b5e-4a48-8c7b-25a0c0d5aa29 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:32.825623 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc5e7ba3-7b5e-4a48-8c7b-25a0c0d5aa29 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:32.827018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9ca607fb-b46d-4aa9-b79a-1eee8dd100a3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:32.828239 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9ca607fb-b46d-4aa9-b79a-1eee8dd100a3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:32.829241 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9ca607fb-b46d-4aa9-b79a-1eee8dd100a3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:32.829734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9ca607fb-b46d-4aa9-b79a-1eee8dd100a3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:33.019140 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dc5e7ba3-7b5e-4a48-8c7b-25a0c0d5aa29 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:33.027430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dc5e7ba3-7b5e-4a48-8c7b-25a0c0d5aa29 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.219439 Jun 29 08:36:33.028503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 118/230] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:32 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:33.030710 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9ca607fb-b46d-4aa9-b79a-1eee8dd100a3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:33.038790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9ca607fb-b46d-4aa9-b79a-1eee8dd100a3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.231195 Jun 29 08:36:33.039594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 113/231] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:32 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:33.824287 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:33.824830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-60b796bf-b8ac-45d3-b89a-d3a66d71dc9b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:33.825196 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:33.825306 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-60b796bf-b8ac-45d3-b89a-d3a66d71dc9b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:33.832328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-60b796bf-b8ac-45d3-b89a-d3a66d71dc9b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:33.832826 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-60b796bf-b8ac-45d3-b89a-d3a66d71dc9b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:33.833158 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:33.833664 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-60b796bf-b8ac-45d3-b89a-d3a66d71dc9b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:33.833765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:33.834113 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-60b796bf-b8ac-45d3-b89a-d3a66d71dc9b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:33.834566 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:33.835019 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:34.030179 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:34.033366 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-60b796bf-b8ac-45d3-b89a-d3a66d71dc9b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:34.041491 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-60b796bf-b8ac-45d3-b89a-d3a66d71dc9b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.221129 Jun 29 08:36:34.042064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 114/232] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:33 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:34.046601 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1654d9b3-7404-4e5e-ae2a-8ccc47051dfc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:34.047243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1654d9b3-7404-4e5e-ae2a-8ccc47051dfc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:34.053522 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1654d9b3-7404-4e5e-ae2a-8ccc47051dfc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:34.053961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1654d9b3-7404-4e5e-ae2a-8ccc47051dfc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:34.054284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:34.054733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1654d9b3-7404-4e5e-ae2a-8ccc47051dfc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:34.055178 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1654d9b3-7404-4e5e-ae2a-8ccc47051dfc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:34.056095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:34.057332 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-55003cc0-64fd-4684-a82e-aacd34a89978 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.237052 Jun 29 08:36:34.057957 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 119/233] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:33 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:34.062379 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8767dd61-458a-40a5-b4cf-43a2fc75dde4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:34.062973 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8767dd61-458a-40a5-b4cf-43a2fc75dde4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:34.069809 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8767dd61-458a-40a5-b4cf-43a2fc75dde4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:34.070306 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8767dd61-458a-40a5-b4cf-43a2fc75dde4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:34.071176 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8767dd61-458a-40a5-b4cf-43a2fc75dde4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:34.071829 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8767dd61-458a-40a5-b4cf-43a2fc75dde4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:34.273766 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1654d9b3-7404-4e5e-ae2a-8ccc47051dfc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:34.277696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8767dd61-458a-40a5-b4cf-43a2fc75dde4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:34.282500 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1654d9b3-7404-4e5e-ae2a-8ccc47051dfc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.239410 Jun 29 08:36:34.286815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 115/234] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:34 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:34.290071 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8767dd61-458a-40a5-b4cf-43a2fc75dde4 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.230900 Jun 29 08:36:34.290798 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 120/235] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:34 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:35.057558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c9667b58-746f-4c6f-9fb7-c90326673f8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:35.058166 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c9667b58-746f-4c6f-9fb7-c90326673f8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:35.064375 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c9667b58-746f-4c6f-9fb7-c90326673f8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:35.065781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c9667b58-746f-4c6f-9fb7-c90326673f8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:35.065781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c9667b58-746f-4c6f-9fb7-c90326673f8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:35.066106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c9667b58-746f-4c6f-9fb7-c90326673f8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:35.084076 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:35.088049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:35.095210 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:35.095726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:35.096575 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:35.097041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:35.280064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c9667b58-746f-4c6f-9fb7-c90326673f8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:35.291674 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c9667b58-746f-4c6f-9fb7-c90326673f8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.237924 Jun 29 08:36:35.294642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 116/236] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:35 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:35.300955 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0c701968-950f-4c0d-a5dc-6c500411587c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:35.301733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0c701968-950f-4c0d-a5dc-6c500411587c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:35.302339 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:35.308285 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c701968-950f-4c0d-a5dc-6c500411587c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:35.308921 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c701968-950f-4c0d-a5dc-6c500411587c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:35.309841 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c701968-950f-4c0d-a5dc-6c500411587c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:35.310560 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c701968-950f-4c0d-a5dc-6c500411587c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:35.310801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:35.312425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:35.313636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3e2a5e1b-45d1-4b59-9516-7a679d79c4ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.233406 Jun 29 08:36:35.314355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 121/237] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:35 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:35.319172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-813e7bb2-c56b-4c28-87e5-3f5f02224c78 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:35.320055 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-813e7bb2-c56b-4c28-87e5-3f5f02224c78 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:35.326213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-813e7bb2-c56b-4c28-87e5-3f5f02224c78 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:35.326764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-813e7bb2-c56b-4c28-87e5-3f5f02224c78 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:35.327586 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-813e7bb2-c56b-4c28-87e5-3f5f02224c78 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:35.328119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-813e7bb2-c56b-4c28-87e5-3f5f02224c78 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:35.536121 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-813e7bb2-c56b-4c28-87e5-3f5f02224c78 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:35.539540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0c701968-950f-4c0d-a5dc-6c500411587c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:35.544848 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-813e7bb2-c56b-4c28-87e5-3f5f02224c78 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.229112 Jun 29 08:36:35.545569 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 122/238] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:35 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:35.548536 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0c701968-950f-4c0d-a5dc-6c500411587c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.252605 Jun 29 08:36:35.549118 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 117/239] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:35 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:36.308988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d8184da7-1c2d-48ad-8f51-3804162f47d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:36.309778 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d8184da7-1c2d-48ad-8f51-3804162f47d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:36.316682 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8184da7-1c2d-48ad-8f51-3804162f47d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:36.317120 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8184da7-1c2d-48ad-8f51-3804162f47d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:36.317874 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8184da7-1c2d-48ad-8f51-3804162f47d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:36.318461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8184da7-1c2d-48ad-8f51-3804162f47d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:36.333123 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:36.333879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:36.343459 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:36.344072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:36.345051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:36.345574 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:36.532016 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d8184da7-1c2d-48ad-8f51-3804162f47d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:36.540318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d8184da7-1c2d-48ad-8f51-3804162f47d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.235506 Jun 29 08:36:36.541039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:36.541245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 123/240] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:36 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:36.550544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:36.552357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:36.553457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-72428baf-8bb2-4ec7-9e37-202f6e1b448f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.225356 Jun 29 08:36:36.554001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 118/241] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:36 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:36:36.561616 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9e65352e-0263-40b2-b107-8642b90941d9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:36.562402 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9e65352e-0263-40b2-b107-8642b90941d9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:36.570211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-556ec413-de3c-420c-903d-a6ea5a5fecb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:36.571001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-556ec413-de3c-420c-903d-a6ea5a5fecb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:36.572784 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e65352e-0263-40b2-b107-8642b90941d9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:36.573471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e65352e-0263-40b2-b107-8642b90941d9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:36.574397 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e65352e-0263-40b2-b107-8642b90941d9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:36.575786 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e65352e-0263-40b2-b107-8642b90941d9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:36.580306 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-556ec413-de3c-420c-903d-a6ea5a5fecb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:36.580861 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-556ec413-de3c-420c-903d-a6ea5a5fecb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:36.581747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-556ec413-de3c-420c-903d-a6ea5a5fecb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:36.582505 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-556ec413-de3c-420c-903d-a6ea5a5fecb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:36.789810 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-556ec413-de3c-420c-903d-a6ea5a5fecb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:36.798216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-556ec413-de3c-420c-903d-a6ea5a5fecb4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.235435 Jun 29 08:36:36.798918 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 119/242] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:36 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:36.807790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9e65352e-0263-40b2-b107-8642b90941d9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:36.815524 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9e65352e-0263-40b2-b107-8642b90941d9 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1315 microversion: 2.1 time: 0.257993 Jun 29 08:36:36.816385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 124/243] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:36 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:37.557963 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3117f2b3-1c9e-469e-8c9d-62e827ed9355 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:37.558810 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3117f2b3-1c9e-469e-8c9d-62e827ed9355 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:37.567015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=96 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:37.568539 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3117f2b3-1c9e-469e-8c9d-62e827ed9355 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:37.569123 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3117f2b3-1c9e-469e-8c9d-62e827ed9355 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:37.569890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3117f2b3-1c9e-469e-8c9d-62e827ed9355 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:37.570309 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3117f2b3-1c9e-469e-8c9d-62e827ed9355 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:37.572215 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:37.573351 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:37.575467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=98 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:37.581680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:37.582259 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:37.583430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:37.585168 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:37.890327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3117f2b3-1c9e-469e-8c9d-62e827ed9355 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:37.906515 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:37.908278 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3117f2b3-1c9e-469e-8c9d-62e827ed9355 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.353162 Jun 29 08:36:37.911571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 120/244] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:37 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:37.918173 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:37.920688 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:37.922959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4d28eccb-2e3b-436c-a383-d18584f8d1ac tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.355103 Jun 29 08:36:37.924572 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-414783ec-ebc1-4296-a81e-ef0a55bd0f23 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:37.924855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 125/245] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:37 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:36:37.926366 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-414783ec-ebc1-4296-a81e-ef0a55bd0f23 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:37.930825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2ef20b62-3d7a-499f-8dcb-265a153c195c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:37.931610 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2ef20b62-3d7a-499f-8dcb-265a153c195c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:37.940609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-414783ec-ebc1-4296-a81e-ef0a55bd0f23 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:37.941217 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-414783ec-ebc1-4296-a81e-ef0a55bd0f23 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:37.942366 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ef20b62-3d7a-499f-8dcb-265a153c195c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:37.942499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-414783ec-ebc1-4296-a81e-ef0a55bd0f23 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:37.942899 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-414783ec-ebc1-4296-a81e-ef0a55bd0f23 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:37.943002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ef20b62-3d7a-499f-8dcb-265a153c195c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:37.943726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ef20b62-3d7a-499f-8dcb-265a153c195c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:37.944147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ef20b62-3d7a-499f-8dcb-265a153c195c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:38.169336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2ef20b62-3d7a-499f-8dcb-265a153c195c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:38.173550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-414783ec-ebc1-4296-a81e-ef0a55bd0f23 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:38.177855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2ef20b62-3d7a-499f-8dcb-265a153c195c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1501 microversion: 2.1 time: 0.251957 Jun 29 08:36:38.178608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 126/246] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:37 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:38.184106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-414783ec-ebc1-4296-a81e-ef0a55bd0f23 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.271130 Jun 29 08:36:38.184953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 121/247] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:37 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:38.941148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a39e7ddd-918e-4e4a-a531-15e8e6e8cd1c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:38.942172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a39e7ddd-918e-4e4a-a531-15e8e6e8cd1c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:38.944698 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:38.945959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:38.954896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a39e7ddd-918e-4e4a-a531-15e8e6e8cd1c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:38.955868 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a39e7ddd-918e-4e4a-a531-15e8e6e8cd1c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:38.957502 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a39e7ddd-918e-4e4a-a531-15e8e6e8cd1c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:38.958810 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a39e7ddd-918e-4e4a-a531-15e8e6e8cd1c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:38.959400 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:38.959920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:38.960817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:38.962390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:39.398015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a39e7ddd-918e-4e4a-a531-15e8e6e8cd1c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:39.409326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a39e7ddd-918e-4e4a-a531-15e8e6e8cd1c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.485053 Jun 29 08:36:39.410070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 127/248] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:38 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:39.415344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-34525a11-a289-410c-af5b-d69f5bd06923 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:39.416270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-34525a11-a289-410c-af5b-d69f5bd06923 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:39.425677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34525a11-a289-410c-af5b-d69f5bd06923 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:39.426334 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34525a11-a289-410c-af5b-d69f5bd06923 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:39.427350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34525a11-a289-410c-af5b-d69f5bd06923 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:39.428230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34525a11-a289-410c-af5b-d69f5bd06923 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:39.433485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:39.460159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:39.467344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:39.468780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-175e678f-7f63-40d0-b83c-a5505de48037 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.529682 Jun 29 08:36:39.470736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 122/249] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:38 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:36:39.647677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-34525a11-a289-410c-af5b-d69f5bd06923 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:39.662005 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-34525a11-a289-410c-af5b-d69f5bd06923 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.250796 Jun 29 08:36:39.665302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 128/250] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:39 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:40.397431 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-f9f8a470-31a4-4108-9285-3af28fba4968 req-bea00bec-813b-4334-a81e-49100e7e20c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f1f6d1-d03f-4304-b607-4ea8870be425", "name": "network-vif-plugged", "status": "completed", "tag": "b9ea90f6-200e-4036-bc3d-b3961c2cd7f6"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:36:40.415157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f9f8a470-31a4-4108-9285-3af28fba4968 req-bea00bec-813b-4334-a81e-49100e7e20c8 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:40.417877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f9f8a470-31a4-4108-9285-3af28fba4968 req-bea00bec-813b-4334-a81e-49100e7e20c8 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:40.427301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-156091f3-8d48-4441-a273-3fb2d05a1e95 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:40.428828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-156091f3-8d48-4441-a273-3fb2d05a1e95 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:40.441724 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-156091f3-8d48-4441-a273-3fb2d05a1e95 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:40.442976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-156091f3-8d48-4441-a273-3fb2d05a1e95 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:40.444881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-156091f3-8d48-4441-a273-3fb2d05a1e95 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:40.445579 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-156091f3-8d48-4441-a273-3fb2d05a1e95 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:40.485835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-f9f8a470-31a4-4108-9285-3af28fba4968 req-bea00bec-813b-4334-a81e-49100e7e20c8 service nova] Creating event network-vif-plugged:b9ea90f6-200e-4036-bc3d-b3961c2cd7f6 for instance b8f1f6d1-d03f-4304-b607-4ea8870be425 on hv-cinder-79760 Jun 29 08:36:40.518728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-f9f8a470-31a4-4108-9285-3af28fba4968 req-bea00bec-813b-4334-a81e-49100e7e20c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126318 Jun 29 08:36:40.523594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 123/251] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:36:40.534432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:40.537061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:40.555718 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:40.559521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:40.562677 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:40.574225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:40.727850 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-156091f3-8d48-4441-a273-3fb2d05a1e95 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:40.731322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:40.738518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-156091f3-8d48-4441-a273-3fb2d05a1e95 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.315785 Jun 29 08:36:40.739490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 129/252] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:40 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:40.745249 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b124b9c2-0745-44b5-9b31-5358668de77c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:40.745992 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b124b9c2-0745-44b5-9b31-5358668de77c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:40.754166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b124b9c2-0745-44b5-9b31-5358668de77c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:40.754822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b124b9c2-0745-44b5-9b31-5358668de77c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:40.755730 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b124b9c2-0745-44b5-9b31-5358668de77c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:40.756431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b124b9c2-0745-44b5-9b31-5358668de77c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:40.805425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:40.816689 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:40.819326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:40.821959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-38d02ed2-5429-49be-a5db-105121378f52 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.297150 Jun 29 08:36:40.823859 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 124/253] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:40 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:40.932964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b124b9c2-0745-44b5-9b31-5358668de77c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:40.941673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b124b9c2-0745-44b5-9b31-5358668de77c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.200811 Jun 29 08:36:40.942530 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 130/254] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:40 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:41.063243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1c0da96b-a731-4263-8952-748efdc8274e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c5085fc-5982-4cb6-a08b-717400aca183"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:36:41.064415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1c0da96b-a731-4263-8952-748efdc8274e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:41.070422 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c0da96b-a731-4263-8952-748efdc8274e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:41.071521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c0da96b-a731-4263-8952-748efdc8274e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:41.072483 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c0da96b-a731-4263-8952-748efdc8274e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:41.073085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c0da96b-a731-4263-8952-748efdc8274e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:41.756041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3e559e28-7d63-485c-aaf0-b83b19a47cb8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:41.757294 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3e559e28-7d63-485c-aaf0-b83b19a47cb8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:41.765220 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e559e28-7d63-485c-aaf0-b83b19a47cb8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:41.766114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e559e28-7d63-485c-aaf0-b83b19a47cb8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:41.767213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e559e28-7d63-485c-aaf0-b83b19a47cb8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:41.768504 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e559e28-7d63-485c-aaf0-b83b19a47cb8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:41.955736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e559e28-7d63-485c-aaf0-b83b19a47cb8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:41.967441 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3e559e28-7d63-485c-aaf0-b83b19a47cb8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.215197 Jun 29 08:36:41.971372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 131/255] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:41 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:41.979094 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:41.979698 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:42.003657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:42.004886 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:42.005921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:42.006498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:42.159539 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:42.168244 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:42.170029 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:42.171359 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b6fb1110-f360-4427-9ae7-6aea1985e058 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.198822 Jun 29 08:36:42.182641 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 132/256] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:41 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:42.187790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-42212100-ee6c-46e4-a8dc-459782a0c088 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:42.188769 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-42212100-ee6c-46e4-a8dc-459782a0c088 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:42.195216 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42212100-ee6c-46e4-a8dc-459782a0c088 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:42.195865 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42212100-ee6c-46e4-a8dc-459782a0c088 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:42.196831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42212100-ee6c-46e4-a8dc-459782a0c088 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:42.197435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42212100-ee6c-46e4-a8dc-459782a0c088 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:42.365424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-42212100-ee6c-46e4-a8dc-459782a0c088 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:42.375358 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-42212100-ee6c-46e4-a8dc-459782a0c088 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1321 microversion: 2.1 time: 0.191099 Jun 29 08:36:42.376375 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 133/257] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:42 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:42.985500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2b3b8b9c-58e9-4396-92ae-ee4b17c0201d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:42.986302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2b3b8b9c-58e9-4396-92ae-ee4b17c0201d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:42.994366 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b3b8b9c-58e9-4396-92ae-ee4b17c0201d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:42.994839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b3b8b9c-58e9-4396-92ae-ee4b17c0201d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:42.996189 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b3b8b9c-58e9-4396-92ae-ee4b17c0201d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:42.996680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b3b8b9c-58e9-4396-92ae-ee4b17c0201d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:43.182189 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2b3b8b9c-58e9-4396-92ae-ee4b17c0201d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:43.207572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2b3b8b9c-58e9-4396-92ae-ee4b17c0201d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.225974 Jun 29 08:36:43.209831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 134/258] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:42 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:43.226259 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:43.227287 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:43.240488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:43.241228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:43.242733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:43.243389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:43.408245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:43.417216 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:43.418825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:43.420001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c9249b6c-5d72-4b03-996b-680ff8239804 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.209367 Jun 29 08:36:43.420622 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 135/259] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:43 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:43.425159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dce3cdff-f52f-4404-aec5-696c5fea61a1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:43.425749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dce3cdff-f52f-4404-aec5-696c5fea61a1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:43.431621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dce3cdff-f52f-4404-aec5-696c5fea61a1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:43.432325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dce3cdff-f52f-4404-aec5-696c5fea61a1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:43.433278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dce3cdff-f52f-4404-aec5-696c5fea61a1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:43.434133 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dce3cdff-f52f-4404-aec5-696c5fea61a1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:43.587941 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dce3cdff-f52f-4404-aec5-696c5fea61a1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:43.603337 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dce3cdff-f52f-4404-aec5-696c5fea61a1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1515 microversion: 2.1 time: 0.181528 Jun 29 08:36:43.604049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 136/260] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:43 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:43.622416 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8918a0bf-f158-4fcf-aa41-60421a9b8d66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:36:43.623465 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8918a0bf-f158-4fcf-aa41-60421a9b8d66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:43.629836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8918a0bf-f158-4fcf-aa41-60421a9b8d66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:43.630239 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8918a0bf-f158-4fcf-aa41-60421a9b8d66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:43.631024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8918a0bf-f158-4fcf-aa41-60421a9b8d66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:43.631457 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8918a0bf-f158-4fcf-aa41-60421a9b8d66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:43.692652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-8918a0bf-f158-4fcf-aa41-60421a9b8d66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lazy-loading 'flavor' on Instance uuid 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:36:43.839613 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8918a0bf-f158-4fcf-aa41-60421a9b8d66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8/action" status: 200 len: 32 microversion: 2.1 time: 0.220796 Jun 29 08:36:43.842868 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 137/261] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:36:43 2022] POST /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:36:43.860693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-29393a2c-b21e-4d0f-b747-c241fb2986ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:43.862075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-29393a2c-b21e-4d0f-b747-c241fb2986ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:43.871031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-29393a2c-b21e-4d0f-b747-c241fb2986ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:43.871505 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-29393a2c-b21e-4d0f-b747-c241fb2986ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:43.872312 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-29393a2c-b21e-4d0f-b747-c241fb2986ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:43.872747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-29393a2c-b21e-4d0f-b747-c241fb2986ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:44.114637 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-29393a2c-b21e-4d0f-b747-c241fb2986ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:44.127027 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-29393a2c-b21e-4d0f-b747-c241fb2986ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.274981 Jun 29 08:36:44.128518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 138/262] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:43 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:44.226165 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec28432d-61d0-4b6e-b99e-e1c7616c5945 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:44.228551 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec28432d-61d0-4b6e-b99e-e1c7616c5945 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:44.236738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec28432d-61d0-4b6e-b99e-e1c7616c5945 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:44.237370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec28432d-61d0-4b6e-b99e-e1c7616c5945 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:44.238645 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec28432d-61d0-4b6e-b99e-e1c7616c5945 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:44.239338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec28432d-61d0-4b6e-b99e-e1c7616c5945 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:44.595885 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec28432d-61d0-4b6e-b99e-e1c7616c5945 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:44.603339 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec28432d-61d0-4b6e-b99e-e1c7616c5945 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.381432 Jun 29 08:36:44.604025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 139/263] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:44 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:36:44.608541 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:44.609322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:44.615654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:44.616096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:44.616861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:44.617287 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:44.843767 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1c0da96b-a731-4263-8952-748efdc8274e tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "POST /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.784569 Jun 29 08:36:44.845280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 125/264] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:36:41 2022] POST /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a/os-volume_attachments => generated 194 bytes in 3787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:36:44.865228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:44.874162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:44.875862 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:44.876981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9ea62b6b-821b-431a-a9f3-db8784a136c2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.272045 Jun 29 08:36:44.877541 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 140/265] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:44 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:45.145735 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2b4ca5a3-2afa-42ed-abe8-2d34693c5cfb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:45.146436 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2b4ca5a3-2afa-42ed-abe8-2d34693c5cfb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:45.153182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2b4ca5a3-2afa-42ed-abe8-2d34693c5cfb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:45.153620 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2b4ca5a3-2afa-42ed-abe8-2d34693c5cfb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:45.154379 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2b4ca5a3-2afa-42ed-abe8-2d34693c5cfb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:45.154837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2b4ca5a3-2afa-42ed-abe8-2d34693c5cfb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:45.303111 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2b4ca5a3-2afa-42ed-abe8-2d34693c5cfb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:45.309492 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:45.312523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2b4ca5a3-2afa-42ed-abe8-2d34693c5cfb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.171716 Jun 29 08:36:45.313791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 126/266] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:45 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:45.622474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-796a9c9d-f424-4858-96cc-6606fbc6e561 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:45.623124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-796a9c9d-f424-4858-96cc-6606fbc6e561 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:45.629848 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-796a9c9d-f424-4858-96cc-6606fbc6e561 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:45.630284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-796a9c9d-f424-4858-96cc-6606fbc6e561 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:45.631227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-796a9c9d-f424-4858-96cc-6606fbc6e561 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:45.632145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-796a9c9d-f424-4858-96cc-6606fbc6e561 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:45.773012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-796a9c9d-f424-4858-96cc-6606fbc6e561 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:45.782278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-796a9c9d-f424-4858-96cc-6606fbc6e561 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.165480 Jun 29 08:36:45.783040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 141/267] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:45 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:45.894640 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:45.895288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:45.902501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:45.902971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:45.903733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:45.904159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:46.040355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:46.048580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:46.050062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:46.051199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-fe1dadfd-b40f-4eb0-919e-ac387f466b9c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.160667 Jun 29 08:36:46.051757 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 127/268] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:45 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:46.340476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-62c5cf90-da39-4f4a-adff-5ddf84351594 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:46.341142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-62c5cf90-da39-4f4a-adff-5ddf84351594 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:46.347635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-62c5cf90-da39-4f4a-adff-5ddf84351594 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:46.348002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-62c5cf90-da39-4f4a-adff-5ddf84351594 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:46.348743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-62c5cf90-da39-4f4a-adff-5ddf84351594 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:46.349164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-62c5cf90-da39-4f4a-adff-5ddf84351594 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:46.480517 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-62c5cf90-da39-4f4a-adff-5ddf84351594 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:46.488000 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-62c5cf90-da39-4f4a-adff-5ddf84351594 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.152277 Jun 29 08:36:46.488555 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 142/269] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:46 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:46.798935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f6390056-2efd-422d-bb51-6491e38de7f6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:46.799543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f6390056-2efd-422d-bb51-6491e38de7f6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:46.806269 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f6390056-2efd-422d-bb51-6491e38de7f6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:46.806721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f6390056-2efd-422d-bb51-6491e38de7f6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:46.807482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f6390056-2efd-422d-bb51-6491e38de7f6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:46.807906 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f6390056-2efd-422d-bb51-6491e38de7f6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:46.946425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f6390056-2efd-422d-bb51-6491e38de7f6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:46.953999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f6390056-2efd-422d-bb51-6491e38de7f6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.159328 Jun 29 08:36:46.954862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 128/270] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:46 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:47.069555 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:47.070174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:47.076147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:47.076569 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:47.077317 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:47.077746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:47.210715 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:47.219408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:47.220909 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:47.222006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d19b2e80-86f3-4b4a-a5d8-f14df3f45cad tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.156404 Jun 29 08:36:47.222565 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 143/271] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:47 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:36:47.505035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-41661b8b-ffcf-4cd4-8e8b-82ba4fb4fb11 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:47.505637 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-41661b8b-ffcf-4cd4-8e8b-82ba4fb4fb11 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:47.512327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41661b8b-ffcf-4cd4-8e8b-82ba4fb4fb11 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:47.512761 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41661b8b-ffcf-4cd4-8e8b-82ba4fb4fb11 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:47.513511 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41661b8b-ffcf-4cd4-8e8b-82ba4fb4fb11 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:47.513934 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41661b8b-ffcf-4cd4-8e8b-82ba4fb4fb11 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:47.667348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-41661b8b-ffcf-4cd4-8e8b-82ba4fb4fb11 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:47.675070 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-41661b8b-ffcf-4cd4-8e8b-82ba4fb4fb11 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.173949 Jun 29 08:36:47.675643 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 129/272] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:47 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:47.972191 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cf021342-8067-4d0f-ba78-5048eecab748 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:47.972798 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cf021342-8067-4d0f-ba78-5048eecab748 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:47.979380 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cf021342-8067-4d0f-ba78-5048eecab748 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:47.979823 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cf021342-8067-4d0f-ba78-5048eecab748 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:47.980577 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cf021342-8067-4d0f-ba78-5048eecab748 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:47.980998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cf021342-8067-4d0f-ba78-5048eecab748 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:48.000074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:36:48.117217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cf021342-8067-4d0f-ba78-5048eecab748 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:48.127774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cf021342-8067-4d0f-ba78-5048eecab748 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.159147 Jun 29 08:36:48.128352 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 144/273] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:47 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:48.239461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:48.240064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:48.246671 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:48.247213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:48.247959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:48.248383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:48.387348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:48.395449 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:48.396939 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:48.398041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-67802492-4a4b-4014-9789-0e2ec970a9c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.162583 Jun 29 08:36:48.398576 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 130/274] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:48 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:48.692175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a5b2833c-f208-480f-b9cd-0f598348fb02 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:48.692778 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a5b2833c-f208-480f-b9cd-0f598348fb02 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:48.698794 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a5b2833c-f208-480f-b9cd-0f598348fb02 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:48.699230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a5b2833c-f208-480f-b9cd-0f598348fb02 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:48.699968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a5b2833c-f208-480f-b9cd-0f598348fb02 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:48.700381 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a5b2833c-f208-480f-b9cd-0f598348fb02 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:48.838257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a5b2833c-f208-480f-b9cd-0f598348fb02 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:48.846971 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a5b2833c-f208-480f-b9cd-0f598348fb02 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.158869 Jun 29 08:36:48.847504 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 145/275] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:48 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:49.145577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cdefc554-d2d6-452c-8c39-51cf47dd0a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:49.146327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cdefc554-d2d6-452c-8c39-51cf47dd0a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:49.152859 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdefc554-d2d6-452c-8c39-51cf47dd0a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:49.153645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdefc554-d2d6-452c-8c39-51cf47dd0a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:49.154507 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdefc554-d2d6-452c-8c39-51cf47dd0a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:49.154967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdefc554-d2d6-452c-8c39-51cf47dd0a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:49.287218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cdefc554-d2d6-452c-8c39-51cf47dd0a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:49.294900 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cdefc554-d2d6-452c-8c39-51cf47dd0a2c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1366 microversion: 2.1 time: 0.153888 Jun 29 08:36:49.304357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 131/276] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:49 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:49.415729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:49.416350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:49.422495 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:49.422961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:49.423737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:49.424193 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:49.559019 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:49.567227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:49.568740 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:49.569859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-11ecdd4a-1e16-48a1-ac6f-145420f18d45 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.158150 Jun 29 08:36:49.570409 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 146/277] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:49 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:49.865498 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0981b8b6-a379-4932-ac88-cff74b52461a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:49.866091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0981b8b6-a379-4932-ac88-cff74b52461a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:49.872102 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0981b8b6-a379-4932-ac88-cff74b52461a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:49.872533 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0981b8b6-a379-4932-ac88-cff74b52461a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:49.873295 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0981b8b6-a379-4932-ac88-cff74b52461a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:49.873686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0981b8b6-a379-4932-ac88-cff74b52461a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:50.011719 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0981b8b6-a379-4932-ac88-cff74b52461a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:50.019559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0981b8b6-a379-4932-ac88-cff74b52461a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.158213 Jun 29 08:36:50.020130 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 132/278] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:49 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:50.316064 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-06db49a9-f185-49ac-b63e-a06677a2bc8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:50.319482 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-06db49a9-f185-49ac-b63e-a06677a2bc8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:50.330666 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06db49a9-f185-49ac-b63e-a06677a2bc8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:50.332447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06db49a9-f185-49ac-b63e-a06677a2bc8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:50.333857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06db49a9-f185-49ac-b63e-a06677a2bc8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:50.334558 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06db49a9-f185-49ac-b63e-a06677a2bc8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:50.489186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-06db49a9-f185-49ac-b63e-a06677a2bc8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:50.500194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-06db49a9-f185-49ac-b63e-a06677a2bc8a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1555 microversion: 2.1 time: 0.192765 Jun 29 08:36:50.500736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 147/279] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:50 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1555 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:50.517148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-669f6636-ffec-4903-af58-c84c8798ffec tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:50.517743 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-669f6636-ffec-4903-af58-c84c8798ffec tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:50.524626 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-669f6636-ffec-4903-af58-c84c8798ffec tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:50.525049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-669f6636-ffec-4903-af58-c84c8798ffec tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:50.525812 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-669f6636-ffec-4903-af58-c84c8798ffec tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:50.526363 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-669f6636-ffec-4903-af58-c84c8798ffec tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:50.587379 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:50.588305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:50.595011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:50.595548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:50.596283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:50.596710 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:50.608257 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-669f6636-ffec-4903-af58-c84c8798ffec tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094966 Jun 29 08:36:50.608856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 133/280] 10.222.0.27 () {58 vars in 1274 bytes} [Wed Jun 29 08:36:50 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:36:50.727932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:50.743813 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:50.745543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:50.746897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a22b0bb5-0af1-44ec-8772-b9e35382c0d3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.163445 Jun 29 08:36:50.748346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 148/281] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:50 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:51.037249 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-aa9480ba-3273-4aa7-aaac-8431c234a52d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:51.038294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-aa9480ba-3273-4aa7-aaac-8431c234a52d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:51.045065 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aa9480ba-3273-4aa7-aaac-8431c234a52d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:51.045576 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aa9480ba-3273-4aa7-aaac-8431c234a52d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:51.046415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aa9480ba-3273-4aa7-aaac-8431c234a52d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:51.046933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aa9480ba-3273-4aa7-aaac-8431c234a52d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:51.195120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-aa9480ba-3273-4aa7-aaac-8431c234a52d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:51.202716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-aa9480ba-3273-4aa7-aaac-8431c234a52d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.169741 Jun 29 08:36:51.203510 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 134/282] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:51 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:51.397261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-b279fa7b-791e-4714-bee2-f18ad56d8747 req-58e5db45-4f7a-4f9a-b8aa-810de2c8583c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdb4aec-5168-4f28-b336-45afe2620e64", "name": "network-vif-plugged", "status": "completed", "tag": "4a2b788b-b706-4ae1-a969-16b817f7a8ad"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:36:51.407070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b279fa7b-791e-4714-bee2-f18ad56d8747 req-58e5db45-4f7a-4f9a-b8aa-810de2c8583c service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:51.407535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b279fa7b-791e-4714-bee2-f18ad56d8747 req-58e5db45-4f7a-4f9a-b8aa-810de2c8583c service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:51.420055 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-b279fa7b-791e-4714-bee2-f18ad56d8747 req-58e5db45-4f7a-4f9a-b8aa-810de2c8583c service nova] Creating event network-vif-plugged:4a2b788b-b706-4ae1-a969-16b817f7a8ad for instance dcdb4aec-5168-4f28-b336-45afe2620e64 on hv-cinder-79760 Jun 29 08:36:51.425700 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-b279fa7b-791e-4714-bee2-f18ad56d8747 req-58e5db45-4f7a-4f9a-b8aa-810de2c8583c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032113 Jun 29 08:36:51.426304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 149/283] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:36:51.767458 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:51.768011 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:51.775008 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:51.775454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:51.776275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:51.776713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:51.918222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-4d84c0b1-16eb-4a13-9186-291296fedab8 req-8f8b3a58-b55a-4978-a9c8-baf4d25e872b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ff4bf7-d905-4584-98f7-26236c14a7d8", "tag": "2ed55c94-eef8-437e-ba0f-2a7792313f0d"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:36:51.928712 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-4d84c0b1-16eb-4a13-9186-291296fedab8 req-8f8b3a58-b55a-4978-a9c8-baf4d25e872b service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:51.929233 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-4d84c0b1-16eb-4a13-9186-291296fedab8 req-8f8b3a58-b55a-4978-a9c8-baf4d25e872b service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:51.948792 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-4d84c0b1-16eb-4a13-9186-291296fedab8 req-8f8b3a58-b55a-4978-a9c8-baf4d25e872b service nova] Creating event network-changed:2ed55c94-eef8-437e-ba0f-2a7792313f0d for instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 on hv-cinder-79760 Jun 29 08:36:51.954531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-4d84c0b1-16eb-4a13-9186-291296fedab8 req-8f8b3a58-b55a-4978-a9c8-baf4d25e872b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040760 Jun 29 08:36:51.955319 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 150/284] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:36:51.994983 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:52.007896 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:52.009504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:52.011108 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-78bd32a5-9940-4c8e-b253-c9dfe9b8caa8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.247763 Jun 29 08:36:52.011929 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 135/285] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:51 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:52.222781 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e210b199-15e2-4619-85f0-bd3d56b7b12f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:52.223950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e210b199-15e2-4619-85f0-bd3d56b7b12f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:52.235245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e210b199-15e2-4619-85f0-bd3d56b7b12f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:52.236424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e210b199-15e2-4619-85f0-bd3d56b7b12f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:52.237309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e210b199-15e2-4619-85f0-bd3d56b7b12f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:52.237822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e210b199-15e2-4619-85f0-bd3d56b7b12f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:52.440145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e210b199-15e2-4619-85f0-bd3d56b7b12f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:52.447883 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e210b199-15e2-4619-85f0-bd3d56b7b12f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.231215 Jun 29 08:36:52.457412 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 151/286] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:52 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:53.030862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:53.032090 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:53.039471 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:53.040055 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:53.041216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:53.041659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:53.176130 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:53.184367 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:53.185875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:53.186994 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3d213d8b-9b4c-4106-be53-1bc11d293513 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.160111 Jun 29 08:36:53.187672 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 136/287] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:53 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:53.465749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0ec40f2c-8350-4ad2-a53e-0d930dc0a756 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:53.466350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0ec40f2c-8350-4ad2-a53e-0d930dc0a756 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:53.473102 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ec40f2c-8350-4ad2-a53e-0d930dc0a756 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:53.473524 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ec40f2c-8350-4ad2-a53e-0d930dc0a756 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:53.474566 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ec40f2c-8350-4ad2-a53e-0d930dc0a756 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:53.475046 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ec40f2c-8350-4ad2-a53e-0d930dc0a756 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:53.605998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0ec40f2c-8350-4ad2-a53e-0d930dc0a756 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:53.614087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0ec40f2c-8350-4ad2-a53e-0d930dc0a756 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.153112 Jun 29 08:36:53.614641 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 152/288] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:53 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:54.206319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:54.206957 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:54.214147 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:54.214594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:54.215722 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:54.216152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:54.357214 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:54.365650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:54.367185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:54.368273 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-44536f0f-dd9b-4182-956b-44962b6c353e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.166554 Jun 29 08:36:54.368830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 137/289] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:54 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:54.634393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c4ee5d12-199a-449f-affd-a6c8db6dcc12 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:54.635284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c4ee5d12-199a-449f-affd-a6c8db6dcc12 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:54.646045 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d12-199a-449f-affd-a6c8db6dcc12 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:54.646766 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d12-199a-449f-affd-a6c8db6dcc12 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:54.648119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d12-199a-449f-affd-a6c8db6dcc12 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:54.648823 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d12-199a-449f-affd-a6c8db6dcc12 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:54.802608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c4ee5d12-199a-449f-affd-a6c8db6dcc12 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:54.810579 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c4ee5d12-199a-449f-affd-a6c8db6dcc12 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.182720 Jun 29 08:36:54.811161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 153/290] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:54 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:55.389579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:55.390323 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:55.399955 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:55.400583 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:55.401656 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:55.402267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:55.535157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:55.543503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:55.544997 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:55.546155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e6d23fed-45de-4408-b0e2-b23282ba6541 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.162376 Jun 29 08:36:55.546764 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 138/291] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:55 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:55.832111 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cebe30ac-1934-4f9a-afab-146205ec17de tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:55.833225 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cebe30ac-1934-4f9a-afab-146205ec17de tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:55.840285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cebe30ac-1934-4f9a-afab-146205ec17de tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:55.840732 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cebe30ac-1934-4f9a-afab-146205ec17de tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:55.841486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cebe30ac-1934-4f9a-afab-146205ec17de tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:55.841946 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cebe30ac-1934-4f9a-afab-146205ec17de tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:56.134858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cebe30ac-1934-4f9a-afab-146205ec17de tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:56.154063 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cebe30ac-1934-4f9a-afab-146205ec17de tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.328254 Jun 29 08:36:56.154983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 154/292] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:55 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:56.568278 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:56.569052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:56.579106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:56.579549 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:56.580442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:56.581091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:56.717430 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:56.725958 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:56.727467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:56.728568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ea19c7df-4fc8-4d4d-bcc9-6464436a4578 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.166564 Jun 29 08:36:56.729133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 139/293] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:56 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:57.171880 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2908ae33-95b6-458d-b090-5d2ae2a1a7b8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:57.172487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2908ae33-95b6-458d-b090-5d2ae2a1a7b8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:57.179224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2908ae33-95b6-458d-b090-5d2ae2a1a7b8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:57.179682 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2908ae33-95b6-458d-b090-5d2ae2a1a7b8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:57.180432 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2908ae33-95b6-458d-b090-5d2ae2a1a7b8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:57.180846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2908ae33-95b6-458d-b090-5d2ae2a1a7b8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:57.324293 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2908ae33-95b6-458d-b090-5d2ae2a1a7b8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:57.332408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2908ae33-95b6-458d-b090-5d2ae2a1a7b8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.164398 Jun 29 08:36:57.332979 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 155/294] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:57 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:57.750666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:57.751739 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:57.762597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:57.763383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:57.764622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:57.765329 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:57.901333 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:57.910263 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:57.911981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:57.913081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1053f5eb-cd59-4a89-8046-88a00239a3d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.168978 Jun 29 08:36:57.913672 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 140/295] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:57 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:58.352186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bfc49a73-06a1-4e8b-a600-d01695d5ddca tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:58.352845 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bfc49a73-06a1-4e8b-a600-d01695d5ddca tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:58.359359 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bfc49a73-06a1-4e8b-a600-d01695d5ddca tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:58.359802 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bfc49a73-06a1-4e8b-a600-d01695d5ddca tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:58.360558 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bfc49a73-06a1-4e8b-a600-d01695d5ddca tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:58.360987 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bfc49a73-06a1-4e8b-a600-d01695d5ddca tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:58.494637 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bfc49a73-06a1-4e8b-a600-d01695d5ddca tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:58.502157 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bfc49a73-06a1-4e8b-a600-d01695d5ddca tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.154958 Jun 29 08:36:58.502731 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 156/296] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:58 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:36:58.936249 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:58.937134 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:58.945951 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:58.946394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:58.947184 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:58.947610 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:59.093307 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:59.101843 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:59.103377 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:59.104479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2360b9bd-0982-4614-b361-63410c4f9418 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.175017 Jun 29 08:36:59.105048 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 141/297] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:36:58 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:36:59.520186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3f955b10-d7b2-4bf1-8644-c0adcf6fa509 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:36:59.521430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3f955b10-d7b2-4bf1-8644-c0adcf6fa509 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:36:59.527664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f955b10-d7b2-4bf1-8644-c0adcf6fa509 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:59.528094 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f955b10-d7b2-4bf1-8644-c0adcf6fa509 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:59.529025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f955b10-d7b2-4bf1-8644-c0adcf6fa509 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:36:59.529451 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f955b10-d7b2-4bf1-8644-c0adcf6fa509 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:36:59.672611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3f955b10-d7b2-4bf1-8644-c0adcf6fa509 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:36:59.681638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3f955b10-d7b2-4bf1-8644-c0adcf6fa509 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.165754 Jun 29 08:36:59.682213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 157/298] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:36:59 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:00.122819 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:00.124629 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:00.133143 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:00.133803 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:00.134719 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:00.135218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:00.265619 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:00.275131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:00.276635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:00.277747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-281d3b12-0f84-4655-8367-0f379ca2a465 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.159255 Jun 29 08:37:00.278317 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 142/299] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:37:00 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:37:00.700312 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d4a7c2d1-1e61-49ae-ba44-2d33c43e821f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:00.700850 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d4a7c2d1-1e61-49ae-ba44-2d33c43e821f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:00.708750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4a7c2d1-1e61-49ae-ba44-2d33c43e821f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:00.709107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4a7c2d1-1e61-49ae-ba44-2d33c43e821f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:00.709942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4a7c2d1-1e61-49ae-ba44-2d33c43e821f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:00.710369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4a7c2d1-1e61-49ae-ba44-2d33c43e821f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:00.896125 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4a7c2d1-1e61-49ae-ba44-2d33c43e821f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:00.903631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d4a7c2d1-1e61-49ae-ba44-2d33c43e821f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.208345 Jun 29 08:37:00.904263 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 158/300] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:00 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:01.298610 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:01.299346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:01.307933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:01.308375 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:01.309193 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:01.309655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:01.465426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:01.468603 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:01.473973 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:01.476230 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:01.477484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2c584634-9863-455d-b150-0aa9acd34208 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1408 microversion: 2.20 time: 0.184752 Jun 29 08:37:01.478393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 143/301] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:37:01 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:37:01.921306 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f2b6e89c-675e-4d78-875e-3746f6aef4e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:01.922036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f2b6e89c-675e-4d78-875e-3746f6aef4e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:01.928548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f2b6e89c-675e-4d78-875e-3746f6aef4e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:01.928988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f2b6e89c-675e-4d78-875e-3746f6aef4e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:01.929748 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f2b6e89c-675e-4d78-875e-3746f6aef4e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:01.930232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f2b6e89c-675e-4d78-875e-3746f6aef4e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:02.139716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f2b6e89c-675e-4d78-875e-3746f6aef4e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:02.148810 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f2b6e89c-675e-4d78-875e-3746f6aef4e0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.231289 Jun 29 08:37:02.149961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 159/302] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:01 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:02.503631 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:02.504900 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:02.517302 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:02.517844 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:02.519137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:02.519734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:02.800871 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:02.811580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:02.814315 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:02.815730 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-17683658-e8f0-47e2-9ec0-695f12a1fae5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1601 microversion: 2.20 time: 0.318300 Jun 29 08:37:02.816354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 144/303] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:37:02 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1601 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:37:02.836114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b6d9bf74-73ce-4532-86fc-57731d00229b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:02.836971 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b6d9bf74-73ce-4532-86fc-57731d00229b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:02.848756 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6d9bf74-73ce-4532-86fc-57731d00229b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:02.851722 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6d9bf74-73ce-4532-86fc-57731d00229b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:02.852943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6d9bf74-73ce-4532-86fc-57731d00229b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:02.853606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6d9bf74-73ce-4532-86fc-57731d00229b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:02.943148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b6d9bf74-73ce-4532-86fc-57731d00229b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.112627 Jun 29 08:37:02.944345 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 160/304] 10.222.0.27 () {60 vars in 1315 bytes} [Wed Jun 29 08:37:02 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:37:03.169708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-476c2d74-f980-4f73-93ae-ebfc9758f569 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:03.170638 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-476c2d74-f980-4f73-93ae-ebfc9758f569 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:03.192283 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-476c2d74-f980-4f73-93ae-ebfc9758f569 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:03.195597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-476c2d74-f980-4f73-93ae-ebfc9758f569 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:03.196724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-476c2d74-f980-4f73-93ae-ebfc9758f569 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:03.198215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-476c2d74-f980-4f73-93ae-ebfc9758f569 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:03.512462 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-476c2d74-f980-4f73-93ae-ebfc9758f569 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:03.531933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-476c2d74-f980-4f73-93ae-ebfc9758f569 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.368120 Jun 29 08:37:03.533235 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 145/305] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:03 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:04.364351 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-79da1c4d-ca2d-4621-8f5b-5a7ffe2b87be req-b3a56d29-e191-4506-ab5b-87dcb9079028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcdb4aec-5168-4f28-b336-45afe2620e64", "tag": "4a2b788b-b706-4ae1-a969-16b817f7a8ad"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:04.373620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-79da1c4d-ca2d-4621-8f5b-5a7ffe2b87be req-b3a56d29-e191-4506-ab5b-87dcb9079028 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:04.374055 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-79da1c4d-ca2d-4621-8f5b-5a7ffe2b87be req-b3a56d29-e191-4506-ab5b-87dcb9079028 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:04.387667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-79da1c4d-ca2d-4621-8f5b-5a7ffe2b87be req-b3a56d29-e191-4506-ab5b-87dcb9079028 service nova] Creating event network-changed:4a2b788b-b706-4ae1-a969-16b817f7a8ad for instance dcdb4aec-5168-4f28-b336-45afe2620e64 on hv-cinder-79760 Jun 29 08:37:04.395197 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-79da1c4d-ca2d-4621-8f5b-5a7ffe2b87be req-b3a56d29-e191-4506-ab5b-87dcb9079028 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035612 Jun 29 08:37:04.396160 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 161/306] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:04.551303 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-11dec58c-621b-4e2a-8592-15a537dd81ff tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:04.555375 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-11dec58c-621b-4e2a-8592-15a537dd81ff tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:04.564666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11dec58c-621b-4e2a-8592-15a537dd81ff tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:04.565393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11dec58c-621b-4e2a-8592-15a537dd81ff tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:04.566417 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11dec58c-621b-4e2a-8592-15a537dd81ff tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:04.566943 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11dec58c-621b-4e2a-8592-15a537dd81ff tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:04.883586 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-11dec58c-621b-4e2a-8592-15a537dd81ff tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:04.893978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-11dec58c-621b-4e2a-8592-15a537dd81ff tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.347325 Jun 29 08:37:04.894988 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 146/307] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:04 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:05.912566 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-935831d0-d149-4b60-ac65-9d61a80f965b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:05.914667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-935831d0-d149-4b60-ac65-9d61a80f965b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:05.930174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-935831d0-d149-4b60-ac65-9d61a80f965b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:05.930996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-935831d0-d149-4b60-ac65-9d61a80f965b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:05.931999 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-935831d0-d149-4b60-ac65-9d61a80f965b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:05.932866 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-935831d0-d149-4b60-ac65-9d61a80f965b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:06.091338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-935831d0-d149-4b60-ac65-9d61a80f965b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:06.099279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-935831d0-d149-4b60-ac65-9d61a80f965b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.192254 Jun 29 08:37:06.100025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 162/308] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:05 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:07.116704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e572fbb7-0856-439e-8cd5-9812ad8406df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:07.117305 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e572fbb7-0856-439e-8cd5-9812ad8406df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:07.124158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e572fbb7-0856-439e-8cd5-9812ad8406df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:07.124554 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e572fbb7-0856-439e-8cd5-9812ad8406df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:07.125320 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e572fbb7-0856-439e-8cd5-9812ad8406df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:07.125738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e572fbb7-0856-439e-8cd5-9812ad8406df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:07.259972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e572fbb7-0856-439e-8cd5-9812ad8406df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:07.268715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e572fbb7-0856-439e-8cd5-9812ad8406df tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.155655 Jun 29 08:37:07.278911 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 147/309] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:07 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:07.726609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1532141516", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:07.732521 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=76 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:07.784331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] validate_networks() for None {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:37:08.126101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:37:08.127171 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:37:08.127852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:37:08.128444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:37:08.129681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:37:08.144923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:08.145361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:08.146139 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:08.147028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:08.169408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Getting quotas for project 3faae8ed99784a52b784c22e77de9890. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:37:08.173381 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Getting quotas for user ac61282884a54556bb611c59c30d75a2 and project 3faae8ed99784a52b784c22e77de9890. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:37:08.184583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:37:08.186920 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:37:08.232320 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-43106562-c2cd-4cfd-a301-9b71ebb770f6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509655 Jun 29 08:37:08.232954 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 163/310] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:37:08.243905 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c2471b5c-261c-470b-b73c-2317768567a5 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:08.245137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c2471b5c-261c-470b-b73c-2317768567a5 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:08.247715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=56 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:08.289846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b58abcc-cd9c-4541-a0b6-af0bfb1f1ada tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:08.290447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0b58abcc-cd9c-4541-a0b6-af0bfb1f1ada tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:08.299680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b58abcc-cd9c-4541-a0b6-af0bfb1f1ada tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:08.300456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b58abcc-cd9c-4541-a0b6-af0bfb1f1ada tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:08.303050 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b58abcc-cd9c-4541-a0b6-af0bfb1f1ada tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:08.303050 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b58abcc-cd9c-4541-a0b6-af0bfb1f1ada tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:08.307437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c2471b5c-261c-470b-b73c-2317768567a5 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:08.317888 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c2471b5c-261c-470b-b73c-2317768567a5 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1215 microversion: 2.1 time: 0.078844 Jun 29 08:37:08.319925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 148/311] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:08 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:08.330234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:08.458611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0b58abcc-cd9c-4541-a0b6-af0bfb1f1ada tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:08.467751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0b58abcc-cd9c-4541-a0b6-af0bfb1f1ada tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.182135 Jun 29 08:37:08.468463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 164/312] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:08 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:09.336115 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6668bb8a-8a2c-4f2b-a992-85c5f82244d6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:09.336731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6668bb8a-8a2c-4f2b-a992-85c5f82244d6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:09.344761 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6668bb8a-8a2c-4f2b-a992-85c5f82244d6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:09.345202 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6668bb8a-8a2c-4f2b-a992-85c5f82244d6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:09.345971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6668bb8a-8a2c-4f2b-a992-85c5f82244d6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:09.346522 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6668bb8a-8a2c-4f2b-a992-85c5f82244d6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:09.407216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6668bb8a-8a2c-4f2b-a992-85c5f82244d6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:09.416920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6668bb8a-8a2c-4f2b-a992-85c5f82244d6 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1219 microversion: 2.1 time: 0.084471 Jun 29 08:37:09.417491 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 149/313] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:09 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:09.485738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9c2943e7-4e1e-438b-9c41-4c8fbfedeb84 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:09.486265 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9c2943e7-4e1e-438b-9c41-4c8fbfedeb84 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:09.494032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c2943e7-4e1e-438b-9c41-4c8fbfedeb84 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:09.494456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c2943e7-4e1e-438b-9c41-4c8fbfedeb84 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:09.495290 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c2943e7-4e1e-438b-9c41-4c8fbfedeb84 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:09.495721 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c2943e7-4e1e-438b-9c41-4c8fbfedeb84 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:09.632437 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9c2943e7-4e1e-438b-9c41-4c8fbfedeb84 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:09.640219 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9c2943e7-4e1e-438b-9c41-4c8fbfedeb84 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.158561 Jun 29 08:37:09.640777 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 165/314] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:09 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:10.437570 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3fa4fcec-32c2-4edb-8ed9-8f36b7dd7b0f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:10.438555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3fa4fcec-32c2-4edb-8ed9-8f36b7dd7b0f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:10.449561 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3fa4fcec-32c2-4edb-8ed9-8f36b7dd7b0f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:10.450291 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3fa4fcec-32c2-4edb-8ed9-8f36b7dd7b0f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:10.458634 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3fa4fcec-32c2-4edb-8ed9-8f36b7dd7b0f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:10.458634 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3fa4fcec-32c2-4edb-8ed9-8f36b7dd7b0f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:10.518799 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3fa4fcec-32c2-4edb-8ed9-8f36b7dd7b0f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:10.526368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3fa4fcec-32c2-4edb-8ed9-8f36b7dd7b0f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1219 microversion: 2.1 time: 0.095319 Jun 29 08:37:10.526953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 150/315] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:10 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:10.657346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-44d21318-753e-451a-9fa0-4fdcfe4f8ae5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:10.658007 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-44d21318-753e-451a-9fa0-4fdcfe4f8ae5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:10.667620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-44d21318-753e-451a-9fa0-4fdcfe4f8ae5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:10.668179 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-44d21318-753e-451a-9fa0-4fdcfe4f8ae5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:10.669317 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-44d21318-753e-451a-9fa0-4fdcfe4f8ae5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:10.669834 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-44d21318-753e-451a-9fa0-4fdcfe4f8ae5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:10.815102 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-44d21318-753e-451a-9fa0-4fdcfe4f8ae5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:10.824720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-44d21318-753e-451a-9fa0-4fdcfe4f8ae5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.171328 Jun 29 08:37:10.825284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 166/316] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:10 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:11.550970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e2448cbf-6f0e-466b-8bae-96d86044864b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:11.551697 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e2448cbf-6f0e-466b-8bae-96d86044864b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:11.560429 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e2448cbf-6f0e-466b-8bae-96d86044864b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:11.561049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e2448cbf-6f0e-466b-8bae-96d86044864b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:11.562226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e2448cbf-6f0e-466b-8bae-96d86044864b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:11.562915 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e2448cbf-6f0e-466b-8bae-96d86044864b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:11.625364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e2448cbf-6f0e-466b-8bae-96d86044864b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:11.633754 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e2448cbf-6f0e-466b-8bae-96d86044864b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1219 microversion: 2.1 time: 0.088914 Jun 29 08:37:11.634324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 151/317] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:11 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:11.842076 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fc67460c-4d16-429c-ad1e-208f0541edf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:11.842638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fc67460c-4d16-429c-ad1e-208f0541edf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:11.849209 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc67460c-4d16-429c-ad1e-208f0541edf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:11.849648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc67460c-4d16-429c-ad1e-208f0541edf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:11.850405 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc67460c-4d16-429c-ad1e-208f0541edf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:11.850941 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc67460c-4d16-429c-ad1e-208f0541edf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:11.989782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fc67460c-4d16-429c-ad1e-208f0541edf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:11.997528 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fc67460c-4d16-429c-ad1e-208f0541edf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.159838 Jun 29 08:37:11.998092 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 167/318] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:11 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:12.654157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-220ac7c8-4324-4242-b718-0d8cb7415165 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:12.654719 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-220ac7c8-4324-4242-b718-0d8cb7415165 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:12.663691 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-220ac7c8-4324-4242-b718-0d8cb7415165 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:12.664165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-220ac7c8-4324-4242-b718-0d8cb7415165 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:12.664889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-220ac7c8-4324-4242-b718-0d8cb7415165 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:12.665314 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-220ac7c8-4324-4242-b718-0d8cb7415165 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:12.734163 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-220ac7c8-4324-4242-b718-0d8cb7415165 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:12.741808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-220ac7c8-4324-4242-b718-0d8cb7415165 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1267 microversion: 2.1 time: 0.091631 Jun 29 08:37:12.742381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 152/319] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:12 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:13.020731 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dd4b5b01-843b-45f6-b865-b6fb847f019c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:13.021365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dd4b5b01-843b-45f6-b865-b6fb847f019c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:13.030352 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd4b5b01-843b-45f6-b865-b6fb847f019c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:13.030807 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd4b5b01-843b-45f6-b865-b6fb847f019c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:13.031570 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd4b5b01-843b-45f6-b865-b6fb847f019c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:13.032577 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd4b5b01-843b-45f6-b865-b6fb847f019c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:13.259138 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dd4b5b01-843b-45f6-b865-b6fb847f019c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:13.278198 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dd4b5b01-843b-45f6-b865-b6fb847f019c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.262036 Jun 29 08:37:13.278719 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 168/320] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:13 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:13.759440 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-229dfa3a-b132-4212-be4d-13476acc1e79 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:13.760046 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-229dfa3a-b132-4212-be4d-13476acc1e79 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:13.767215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-229dfa3a-b132-4212-be4d-13476acc1e79 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:13.767736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-229dfa3a-b132-4212-be4d-13476acc1e79 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:13.768593 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-229dfa3a-b132-4212-be4d-13476acc1e79 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:13.769079 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-229dfa3a-b132-4212-be4d-13476acc1e79 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:13.838150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-229dfa3a-b132-4212-be4d-13476acc1e79 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:13.846041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-229dfa3a-b132-4212-be4d-13476acc1e79 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1273 microversion: 2.1 time: 0.090762 Jun 29 08:37:13.846611 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 153/321] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:13 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:14.297238 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e768b0c6-fa30-48eb-b4b2-5a6a983031c6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:14.298002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e768b0c6-fa30-48eb-b4b2-5a6a983031c6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:14.304292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e768b0c6-fa30-48eb-b4b2-5a6a983031c6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:14.304790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e768b0c6-fa30-48eb-b4b2-5a6a983031c6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:14.305705 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e768b0c6-fa30-48eb-b4b2-5a6a983031c6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:14.306214 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e768b0c6-fa30-48eb-b4b2-5a6a983031c6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:14.527735 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e768b0c6-fa30-48eb-b4b2-5a6a983031c6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:14.535545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e768b0c6-fa30-48eb-b4b2-5a6a983031c6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.243591 Jun 29 08:37:14.536133 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 169/322] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:14 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:14.868884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-06c45f39-5069-4eb1-bbe3-7da277e21d83 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:14.870824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-33cd4d17-f0bd-4f29-a041-5401ec20f0ad req-b7552d06-7536-4bab-8e0b-c57d4877afbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2001924-095f-4982-b35b-843f5d93cfd2", "tag": "9fe93f20-f712-4fed-8f97-2586554fad6c"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:14.875211 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-06c45f39-5069-4eb1-bbe3-7da277e21d83 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:14.908862 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06c45f39-5069-4eb1-bbe3-7da277e21d83 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:14.909540 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06c45f39-5069-4eb1-bbe3-7da277e21d83 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:14.910090 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-33cd4d17-f0bd-4f29-a041-5401ec20f0ad req-b7552d06-7536-4bab-8e0b-c57d4877afbb service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:14.910521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-33cd4d17-f0bd-4f29-a041-5401ec20f0ad req-b7552d06-7536-4bab-8e0b-c57d4877afbb service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:14.911119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06c45f39-5069-4eb1-bbe3-7da277e21d83 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:14.912858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06c45f39-5069-4eb1-bbe3-7da277e21d83 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:14.925051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-33cd4d17-f0bd-4f29-a041-5401ec20f0ad req-b7552d06-7536-4bab-8e0b-c57d4877afbb service nova] Creating event network-changed:9fe93f20-f712-4fed-8f97-2586554fad6c for instance b2001924-095f-4982-b35b-843f5d93cfd2 on hv-cinder-79760 Jun 29 08:37:14.935931 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-33cd4d17-f0bd-4f29-a041-5401ec20f0ad req-b7552d06-7536-4bab-8e0b-c57d4877afbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081155 Jun 29 08:37:14.936517 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 154/323] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:15.132682 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-06c45f39-5069-4eb1-bbe3-7da277e21d83 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:15.144269 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-06c45f39-5069-4eb1-bbe3-7da277e21d83 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.284087 Jun 29 08:37:15.146947 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 170/324] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:14 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:15.553741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-11a5f030-6e28-4e4a-a0cf-b52d355fb79d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:15.555061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-11a5f030-6e28-4e4a-a0cf-b52d355fb79d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:15.562190 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11a5f030-6e28-4e4a-a0cf-b52d355fb79d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:15.562926 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11a5f030-6e28-4e4a-a0cf-b52d355fb79d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:15.563724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11a5f030-6e28-4e4a-a0cf-b52d355fb79d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:15.564697 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11a5f030-6e28-4e4a-a0cf-b52d355fb79d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:15.784680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-11a5f030-6e28-4e4a-a0cf-b52d355fb79d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:15.792602 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-11a5f030-6e28-4e4a-a0cf-b52d355fb79d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.243380 Jun 29 08:37:15.793370 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 155/325] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:15 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:16.163232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-06983144-3459-4486-a549-297e075099b0 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:16.163788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-06983144-3459-4486-a549-297e075099b0 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:16.170316 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06983144-3459-4486-a549-297e075099b0 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:16.170764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06983144-3459-4486-a549-297e075099b0 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:16.171517 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06983144-3459-4486-a549-297e075099b0 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:16.171944 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06983144-3459-4486-a549-297e075099b0 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:16.319589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-06983144-3459-4486-a549-297e075099b0 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:16.327361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-06983144-3459-4486-a549-297e075099b0 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.168149 Jun 29 08:37:16.327916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 171/326] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:16 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:16.811870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-08e9cd55-1553-4683-9992-6b57eaf51499 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:16.812585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-08e9cd55-1553-4683-9992-6b57eaf51499 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:16.820169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-08e9cd55-1553-4683-9992-6b57eaf51499 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:16.820695 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-08e9cd55-1553-4683-9992-6b57eaf51499 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:16.821664 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-08e9cd55-1553-4683-9992-6b57eaf51499 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:16.822592 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-08e9cd55-1553-4683-9992-6b57eaf51499 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:17.109704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-08e9cd55-1553-4683-9992-6b57eaf51499 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:17.117435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-08e9cd55-1553-4683-9992-6b57eaf51499 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.310483 Jun 29 08:37:17.118142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 156/327] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:16 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:17.348185 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-48b6fced-107b-43dc-aaf7-a62cbeb7dcd9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:17.348746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-48b6fced-107b-43dc-aaf7-a62cbeb7dcd9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:17.357393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-48b6fced-107b-43dc-aaf7-a62cbeb7dcd9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:17.358103 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-48b6fced-107b-43dc-aaf7-a62cbeb7dcd9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:17.358944 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-48b6fced-107b-43dc-aaf7-a62cbeb7dcd9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:17.359399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-48b6fced-107b-43dc-aaf7-a62cbeb7dcd9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:17.497258 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-48b6fced-107b-43dc-aaf7-a62cbeb7dcd9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:17.507732 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-48b6fced-107b-43dc-aaf7-a62cbeb7dcd9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.165960 Jun 29 08:37:17.512800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 172/328] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:17 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:18.135741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8f6ce4ab-b718-4211-b329-6896cc28d2f1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:18.136335 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8f6ce4ab-b718-4211-b329-6896cc28d2f1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:18.143417 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f6ce4ab-b718-4211-b329-6896cc28d2f1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:18.143856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f6ce4ab-b718-4211-b329-6896cc28d2f1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:18.144605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f6ce4ab-b718-4211-b329-6896cc28d2f1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:18.145030 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f6ce4ab-b718-4211-b329-6896cc28d2f1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:18.289807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8f6ce4ab-b718-4211-b329-6896cc28d2f1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:18.298619 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8f6ce4ab-b718-4211-b329-6896cc28d2f1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.166924 Jun 29 08:37:18.299470 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 157/329] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:18 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:18.524934 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-94889bde-284a-4113-9900-351d2b05ef00 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:18.525536 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-94889bde-284a-4113-9900-351d2b05ef00 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:18.527812 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:18.528424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:18.534603 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94889bde-284a-4113-9900-351d2b05ef00 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:18.535113 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94889bde-284a-4113-9900-351d2b05ef00 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:18.535883 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94889bde-284a-4113-9900-351d2b05ef00 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:18.536311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94889bde-284a-4113-9900-351d2b05ef00 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:18.897675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-94889bde-284a-4113-9900-351d2b05ef00 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:18.912333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-94889bde-284a-4113-9900-351d2b05ef00 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.391171 Jun 29 08:37:18.912983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 173/330] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:18 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:19.316365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a6bf02f9-8619-468e-9d6a-a6f775ed8621 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:19.317647 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a6bf02f9-8619-468e-9d6a-a6f775ed8621 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:19.324245 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:19.328107 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6bf02f9-8619-468e-9d6a-a6f775ed8621 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:19.328665 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6bf02f9-8619-468e-9d6a-a6f775ed8621 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:19.329625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6bf02f9-8619-468e-9d6a-a6f775ed8621 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:19.330141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6bf02f9-8619-468e-9d6a-a6f775ed8621 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:19.479564 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a6bf02f9-8619-468e-9d6a-a6f775ed8621 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:19.487310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a6bf02f9-8619-468e-9d6a-a6f775ed8621 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.175425 Jun 29 08:37:19.488251 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 158/331] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:19 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:19.933590 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7be0abed-cd14-4069-a4c3-559dd2d0015c tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:19.934427 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7be0abed-cd14-4069-a4c3-559dd2d0015c tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:19.940661 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7be0abed-cd14-4069-a4c3-559dd2d0015c tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:19.941088 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7be0abed-cd14-4069-a4c3-559dd2d0015c tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:19.941854 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7be0abed-cd14-4069-a4c3-559dd2d0015c tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:19.942282 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7be0abed-cd14-4069-a4c3-559dd2d0015c tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:20.113715 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7be0abed-cd14-4069-a4c3-559dd2d0015c tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:20.121524 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7be0abed-cd14-4069-a4c3-559dd2d0015c tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.191877 Jun 29 08:37:20.131339 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 174/332] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:19 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:20.507188 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b693a5ee-197e-46bb-bcce-5a8d67297d94 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:20.508149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b693a5ee-197e-46bb-bcce-5a8d67297d94 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:20.515759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b693a5ee-197e-46bb-bcce-5a8d67297d94 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:20.516195 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b693a5ee-197e-46bb-bcce-5a8d67297d94 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:20.516961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b693a5ee-197e-46bb-bcce-5a8d67297d94 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:20.517473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b693a5ee-197e-46bb-bcce-5a8d67297d94 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:20.726923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b693a5ee-197e-46bb-bcce-5a8d67297d94 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:20.736736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b693a5ee-197e-46bb-bcce-5a8d67297d94 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.234627 Jun 29 08:37:20.737805 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 159/333] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:20 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:21.139288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b2a95d24-974c-45d5-8dc6-91421cf3f131 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:21.140048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b2a95d24-974c-45d5-8dc6-91421cf3f131 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:21.146068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2a95d24-974c-45d5-8dc6-91421cf3f131 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:21.146504 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2a95d24-974c-45d5-8dc6-91421cf3f131 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:21.147493 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2a95d24-974c-45d5-8dc6-91421cf3f131 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:21.148105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2a95d24-974c-45d5-8dc6-91421cf3f131 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:21.313881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b2a95d24-974c-45d5-8dc6-91421cf3f131 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:21.326598 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b2a95d24-974c-45d5-8dc6-91421cf3f131 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.191210 Jun 29 08:37:21.327456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 175/334] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:21 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:21.756345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1096408e-f851-4e78-bdfd-73292b543247 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:21.756946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1096408e-f851-4e78-bdfd-73292b543247 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:21.770139 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1096408e-f851-4e78-bdfd-73292b543247 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:21.770577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1096408e-f851-4e78-bdfd-73292b543247 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:21.771385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1096408e-f851-4e78-bdfd-73292b543247 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:21.771815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1096408e-f851-4e78-bdfd-73292b543247 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:21.948091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1096408e-f851-4e78-bdfd-73292b543247 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:21.956534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1096408e-f851-4e78-bdfd-73292b543247 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.204349 Jun 29 08:37:21.957411 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 160/335] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:21 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:22.343739 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-42b1b42d-4986-4ccf-9507-4986b7fb7056 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:22.344353 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-42b1b42d-4986-4ccf-9507-4986b7fb7056 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:22.363447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42b1b42d-4986-4ccf-9507-4986b7fb7056 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:22.363870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42b1b42d-4986-4ccf-9507-4986b7fb7056 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:22.364656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42b1b42d-4986-4ccf-9507-4986b7fb7056 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:22.365325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42b1b42d-4986-4ccf-9507-4986b7fb7056 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:22.573096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-42b1b42d-4986-4ccf-9507-4986b7fb7056 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:22.581497 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-42b1b42d-4986-4ccf-9507-4986b7fb7056 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.241973 Jun 29 08:37:22.582804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 176/336] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:22 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:22.977232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1773493f-8912-441f-918d-beb48b2e4a27 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:22.977841 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1773493f-8912-441f-918d-beb48b2e4a27 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:22.985108 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1773493f-8912-441f-918d-beb48b2e4a27 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:22.985646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1773493f-8912-441f-918d-beb48b2e4a27 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:22.986494 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1773493f-8912-441f-918d-beb48b2e4a27 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:22.986970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1773493f-8912-441f-918d-beb48b2e4a27 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:23.178606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1773493f-8912-441f-918d-beb48b2e4a27 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:23.186545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1773493f-8912-441f-918d-beb48b2e4a27 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.214822 Jun 29 08:37:23.187382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 161/337] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:22 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:23.310856 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cd15da57-0b3c-466a-8640-5f74e5d4b691 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:23.311347 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cd15da57-0b3c-466a-8640-5f74e5d4b691 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:23.317358 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cd15da57-0b3c-466a-8640-5f74e5d4b691 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:23.317791 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cd15da57-0b3c-466a-8640-5f74e5d4b691 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:23.318539 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cd15da57-0b3c-466a-8640-5f74e5d4b691 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:23.318988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cd15da57-0b3c-466a-8640-5f74e5d4b691 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:23.345948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cd15da57-0b3c-466a-8640-5f74e5d4b691 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:37:23.439068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cd15da57-0b3c-466a-8640-5f74e5d4b691 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 204 len: 0 microversion: 2.1 time: 0.131889 Jun 29 08:37:23.439661 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 177/338] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:37:23 2022] DELETE /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:37:23.450875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2a72eff5-3949-490b-9fa3-c1f27382b93d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:23.451807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2a72eff5-3949-490b-9fa3-c1f27382b93d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:23.462563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2a72eff5-3949-490b-9fa3-c1f27382b93d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:23.463260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2a72eff5-3949-490b-9fa3-c1f27382b93d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:23.464317 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2a72eff5-3949-490b-9fa3-c1f27382b93d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:23.465087 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2a72eff5-3949-490b-9fa3-c1f27382b93d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:23.469473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:23.601590 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e2da7205-0d89-4eab-8e9e-8652adcf0b54 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:23.602505 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e2da7205-0d89-4eab-8e9e-8652adcf0b54 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:23.610324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2da7205-0d89-4eab-8e9e-8652adcf0b54 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:23.611070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2da7205-0d89-4eab-8e9e-8652adcf0b54 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:23.612144 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2da7205-0d89-4eab-8e9e-8652adcf0b54 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:23.613151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2da7205-0d89-4eab-8e9e-8652adcf0b54 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:23.639775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2a72eff5-3949-490b-9fa3-c1f27382b93d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:23.652473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2a72eff5-3949-490b-9fa3-c1f27382b93d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.205760 Jun 29 08:37:23.653580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 162/339] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:23 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:23.791219 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e2da7205-0d89-4eab-8e9e-8652adcf0b54 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:23.800442 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e2da7205-0d89-4eab-8e9e-8652adcf0b54 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.204074 Jun 29 08:37:23.801159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 178/340] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:23 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:24.059995 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-52c30c54-9140-46bf-83ed-32544afef346 req-3af23248-9448-4053-b425-4b0c740a7fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2001924-095f-4982-b35b-843f5d93cfd2", "name": "network-vif-plugged", "status": "completed", "tag": "9fe93f20-f712-4fed-8f97-2586554fad6c"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:24.072029 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-52c30c54-9140-46bf-83ed-32544afef346 req-3af23248-9448-4053-b425-4b0c740a7fc4 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:24.072653 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-52c30c54-9140-46bf-83ed-32544afef346 req-3af23248-9448-4053-b425-4b0c740a7fc4 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:24.085405 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-52c30c54-9140-46bf-83ed-32544afef346 req-3af23248-9448-4053-b425-4b0c740a7fc4 service nova] Creating event network-vif-plugged:9fe93f20-f712-4fed-8f97-2586554fad6c for instance b2001924-095f-4982-b35b-843f5d93cfd2 on hv-cinder-79760 Jun 29 08:37:24.094512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-52c30c54-9140-46bf-83ed-32544afef346 req-3af23248-9448-4053-b425-4b0c740a7fc4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038621 Jun 29 08:37:24.095700 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 163/341] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:24.203904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-49b373d4-85c2-4abf-8f6a-6540fb1e29e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:24.204422 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-49b373d4-85c2-4abf-8f6a-6540fb1e29e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:24.211616 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-49b373d4-85c2-4abf-8f6a-6540fb1e29e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:24.212285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-49b373d4-85c2-4abf-8f6a-6540fb1e29e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:24.213194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-49b373d4-85c2-4abf-8f6a-6540fb1e29e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:24.213811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-49b373d4-85c2-4abf-8f6a-6540fb1e29e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:24.220530 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:24.380604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-49b373d4-85c2-4abf-8f6a-6540fb1e29e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:24.389196 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-49b373d4-85c2-4abf-8f6a-6540fb1e29e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.189394 Jun 29 08:37:24.398984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 179/342] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:24 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:24.671640 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6e95b7d2-955c-44a2-b1cf-25ea592bb53d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:24.672339 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6e95b7d2-955c-44a2-b1cf-25ea592bb53d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:24.678590 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6e95b7d2-955c-44a2-b1cf-25ea592bb53d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:24.679067 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6e95b7d2-955c-44a2-b1cf-25ea592bb53d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:24.679831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6e95b7d2-955c-44a2-b1cf-25ea592bb53d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:24.680286 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6e95b7d2-955c-44a2-b1cf-25ea592bb53d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:24.811896 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6e95b7d2-955c-44a2-b1cf-25ea592bb53d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:24.817752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-487698bd-64e5-4622-b004-41dda629f7d1 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:24.818368 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-487698bd-64e5-4622-b004-41dda629f7d1 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:24.820119 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6e95b7d2-955c-44a2-b1cf-25ea592bb53d tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.152758 Jun 29 08:37:24.820691 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 164/343] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:24 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:24.824755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-487698bd-64e5-4622-b004-41dda629f7d1 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:24.825172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-487698bd-64e5-4622-b004-41dda629f7d1 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:24.825986 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-487698bd-64e5-4622-b004-41dda629f7d1 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:24.826413 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-487698bd-64e5-4622-b004-41dda629f7d1 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:24.960944 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-487698bd-64e5-4622-b004-41dda629f7d1 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:24.969707 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-487698bd-64e5-4622-b004-41dda629f7d1 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.155893 Jun 29 08:37:24.970305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 180/344] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:24 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:25.408849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b26beb0f-fba8-48b5-9c66-1de906cfc8cc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:25.409450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b26beb0f-fba8-48b5-9c66-1de906cfc8cc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:25.417287 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b26beb0f-fba8-48b5-9c66-1de906cfc8cc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:25.417721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b26beb0f-fba8-48b5-9c66-1de906cfc8cc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:25.418562 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b26beb0f-fba8-48b5-9c66-1de906cfc8cc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:25.419287 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b26beb0f-fba8-48b5-9c66-1de906cfc8cc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:25.561134 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b26beb0f-fba8-48b5-9c66-1de906cfc8cc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:25.572330 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b26beb0f-fba8-48b5-9c66-1de906cfc8cc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.170197 Jun 29 08:37:25.572868 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 165/345] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:25 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:25.837887 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dde53c1b-ad95-4904-a421-897461190bb3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:25.838594 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dde53c1b-ad95-4904-a421-897461190bb3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:25.846231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dde53c1b-ad95-4904-a421-897461190bb3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:25.846748 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dde53c1b-ad95-4904-a421-897461190bb3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:25.847731 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dde53c1b-ad95-4904-a421-897461190bb3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:25.848159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dde53c1b-ad95-4904-a421-897461190bb3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:25.985994 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dde53c1b-ad95-4904-a421-897461190bb3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:25.986158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4a7cbcc1-139a-43df-89b2-fc548055dcf7 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:25.986765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4a7cbcc1-139a-43df-89b2-fc548055dcf7 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:25.993211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a7cbcc1-139a-43df-89b2-fc548055dcf7 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:25.993643 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a7cbcc1-139a-43df-89b2-fc548055dcf7 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:25.994116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dde53c1b-ad95-4904-a421-897461190bb3 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.160465 Jun 29 08:37:25.994393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a7cbcc1-139a-43df-89b2-fc548055dcf7 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:25.994671 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 181/346] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:25 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:25.994848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a7cbcc1-139a-43df-89b2-fc548055dcf7 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:26.122355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4a7cbcc1-139a-43df-89b2-fc548055dcf7 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:26.130456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4a7cbcc1-139a-43df-89b2-fc548055dcf7 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.148192 Jun 29 08:37:26.131059 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 166/347] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:25 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:26.590108 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-79529d32-828f-4e74-b29f-cc2e799a62d5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:26.591177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-79529d32-828f-4e74-b29f-cc2e799a62d5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:26.597652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79529d32-828f-4e74-b29f-cc2e799a62d5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:26.598087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79529d32-828f-4e74-b29f-cc2e799a62d5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:26.598912 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79529d32-828f-4e74-b29f-cc2e799a62d5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:26.599309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79529d32-828f-4e74-b29f-cc2e799a62d5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:26.736638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-79529d32-828f-4e74-b29f-cc2e799a62d5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:26.744519 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-79529d32-828f-4e74-b29f-cc2e799a62d5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.159206 Jun 29 08:37:26.745159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 182/348] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:26 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:27.013853 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9fd5b680-1506-4a28-8b8d-8deed3091f74 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:27.014766 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9fd5b680-1506-4a28-8b8d-8deed3091f74 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:27.021222 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9fd5b680-1506-4a28-8b8d-8deed3091f74 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:27.021514 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9fd5b680-1506-4a28-8b8d-8deed3091f74 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:27.022269 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9fd5b680-1506-4a28-8b8d-8deed3091f74 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:27.022715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9fd5b680-1506-4a28-8b8d-8deed3091f74 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:27.150592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-aaacceaf-a2f6-4140-882a-677b485659da tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:27.152374 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-aaacceaf-a2f6-4140-882a-677b485659da tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:27.161888 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9fd5b680-1506-4a28-8b8d-8deed3091f74 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:27.165693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaacceaf-a2f6-4140-882a-677b485659da tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:27.167435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaacceaf-a2f6-4140-882a-677b485659da tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:27.171926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaacceaf-a2f6-4140-882a-677b485659da tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:27.172560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaacceaf-a2f6-4140-882a-677b485659da tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:27.178383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9fd5b680-1506-4a28-8b8d-8deed3091f74 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.168758 Jun 29 08:37:27.179156 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 167/349] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:27 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:27.302970 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-aaacceaf-a2f6-4140-882a-677b485659da tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:27.310747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-aaacceaf-a2f6-4140-882a-677b485659da tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.165996 Jun 29 08:37:27.311348 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 183/350] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:27 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:27.765485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6cfed037-889c-4f1f-8e84-765862715190 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:27.766187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6cfed037-889c-4f1f-8e84-765862715190 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:27.773334 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6cfed037-889c-4f1f-8e84-765862715190 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:27.773835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6cfed037-889c-4f1f-8e84-765862715190 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:27.774670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6cfed037-889c-4f1f-8e84-765862715190 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:27.775157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6cfed037-889c-4f1f-8e84-765862715190 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:27.911376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6cfed037-889c-4f1f-8e84-765862715190 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:27.920166 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6cfed037-889c-4f1f-8e84-765862715190 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.160714 Jun 29 08:37:27.920703 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 168/351] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:27 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:28.195973 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-47d72e26-da2d-43bf-a1e4-1b68c93b2e67 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:28.196658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-47d72e26-da2d-43bf-a1e4-1b68c93b2e67 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:28.202988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-47d72e26-da2d-43bf-a1e4-1b68c93b2e67 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:28.203422 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-47d72e26-da2d-43bf-a1e4-1b68c93b2e67 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:28.204303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-47d72e26-da2d-43bf-a1e4-1b68c93b2e67 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:28.204578 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-47d72e26-da2d-43bf-a1e4-1b68c93b2e67 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:28.327905 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-efb5e099-0176-4135-ab9a-b23157068336 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:28.328526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-efb5e099-0176-4135-ab9a-b23157068336 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:28.336614 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-efb5e099-0176-4135-ab9a-b23157068336 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:28.337153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-efb5e099-0176-4135-ab9a-b23157068336 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:28.338218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-efb5e099-0176-4135-ab9a-b23157068336 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:28.338935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-efb5e099-0176-4135-ab9a-b23157068336 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:28.345899 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-47d72e26-da2d-43bf-a1e4-1b68c93b2e67 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:28.354085 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-47d72e26-da2d-43bf-a1e4-1b68c93b2e67 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.162036 Jun 29 08:37:28.354711 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 184/352] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:28 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:28.477341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-efb5e099-0176-4135-ab9a-b23157068336 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:28.485255 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-efb5e099-0176-4135-ab9a-b23157068336 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.161486 Jun 29 08:37:28.485854 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 169/353] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:28 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:28.938369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-831c1982-138e-4783-a3bc-4ba8035e12c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:28.939012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-831c1982-138e-4783-a3bc-4ba8035e12c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:28.945234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-831c1982-138e-4783-a3bc-4ba8035e12c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:28.945674 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-831c1982-138e-4783-a3bc-4ba8035e12c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:28.946420 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-831c1982-138e-4783-a3bc-4ba8035e12c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:28.946875 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-831c1982-138e-4783-a3bc-4ba8035e12c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:29.080263 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-831c1982-138e-4783-a3bc-4ba8035e12c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:29.087817 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-831c1982-138e-4783-a3bc-4ba8035e12c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.153917 Jun 29 08:37:29.088385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 185/354] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:28 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:29.375680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6376e81e-5564-4b52-bee6-31430478ad7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:29.376547 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6376e81e-5564-4b52-bee6-31430478ad7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:29.387780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6376e81e-5564-4b52-bee6-31430478ad7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:29.388227 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6376e81e-5564-4b52-bee6-31430478ad7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:29.388988 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6376e81e-5564-4b52-bee6-31430478ad7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:29.389417 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6376e81e-5564-4b52-bee6-31430478ad7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:29.501752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-304e531f-2ab5-419c-b9b6-dbbe654c7acc tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:29.502266 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-304e531f-2ab5-419c-b9b6-dbbe654c7acc tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:29.511614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-304e531f-2ab5-419c-b9b6-dbbe654c7acc tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:29.512235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-304e531f-2ab5-419c-b9b6-dbbe654c7acc tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:29.513288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-304e531f-2ab5-419c-b9b6-dbbe654c7acc tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:29.513798 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-304e531f-2ab5-419c-b9b6-dbbe654c7acc tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:29.535423 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6376e81e-5564-4b52-bee6-31430478ad7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:29.543560 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6376e81e-5564-4b52-bee6-31430478ad7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.174535 Jun 29 08:37:29.544162 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 170/355] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:29 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:29.654663 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-304e531f-2ab5-419c-b9b6-dbbe654c7acc tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:29.662932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-304e531f-2ab5-419c-b9b6-dbbe654c7acc tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.165267 Jun 29 08:37:29.663474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 186/356] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:29 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:30.107480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e210b90c-0267-49f6-b842-c44214186d7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:30.108076 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e210b90c-0267-49f6-b842-c44214186d7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:30.114493 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e210b90c-0267-49f6-b842-c44214186d7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:30.114962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e210b90c-0267-49f6-b842-c44214186d7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:30.115715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e210b90c-0267-49f6-b842-c44214186d7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:30.116110 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e210b90c-0267-49f6-b842-c44214186d7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:30.246762 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e210b90c-0267-49f6-b842-c44214186d7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:30.254848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e210b90c-0267-49f6-b842-c44214186d7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.152356 Jun 29 08:37:30.255413 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 171/357] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:30 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:30.565252 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7484625b-f64f-43c5-8971-c07e765e7576 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:30.566103 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7484625b-f64f-43c5-8971-c07e765e7576 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:30.576272 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7484625b-f64f-43c5-8971-c07e765e7576 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:30.576716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7484625b-f64f-43c5-8971-c07e765e7576 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:30.577467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7484625b-f64f-43c5-8971-c07e765e7576 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:30.577910 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7484625b-f64f-43c5-8971-c07e765e7576 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:30.680966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f04cae35-8a8b-445c-817e-f858d7baace9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:30.681727 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f04cae35-8a8b-445c-817e-f858d7baace9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:30.689726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f04cae35-8a8b-445c-817e-f858d7baace9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:30.690163 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f04cae35-8a8b-445c-817e-f858d7baace9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:30.691085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f04cae35-8a8b-445c-817e-f858d7baace9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:30.691508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f04cae35-8a8b-445c-817e-f858d7baace9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:30.725053 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7484625b-f64f-43c5-8971-c07e765e7576 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:30.733513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7484625b-f64f-43c5-8971-c07e765e7576 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.175149 Jun 29 08:37:30.734182 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 187/358] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:30 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:30.822755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f04cae35-8a8b-445c-817e-f858d7baace9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:30.831833 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f04cae35-8a8b-445c-817e-f858d7baace9 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.154876 Jun 29 08:37:30.832429 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 172/359] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:30 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:31.279773 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0dbe56e9-32bb-41dc-8bac-bdc574d6c0f2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:31.280750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0dbe56e9-32bb-41dc-8bac-bdc574d6c0f2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:31.291449 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0dbe56e9-32bb-41dc-8bac-bdc574d6c0f2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:31.292222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0dbe56e9-32bb-41dc-8bac-bdc574d6c0f2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:31.293413 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0dbe56e9-32bb-41dc-8bac-bdc574d6c0f2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:31.294117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0dbe56e9-32bb-41dc-8bac-bdc574d6c0f2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:31.428632 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0dbe56e9-32bb-41dc-8bac-bdc574d6c0f2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:31.441265 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0dbe56e9-32bb-41dc-8bac-bdc574d6c0f2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.167692 Jun 29 08:37:31.442105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 188/360] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:31 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:31.752416 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d3750d43-6817-487e-bbcd-da26574bf2f2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:31.753062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d3750d43-6817-487e-bbcd-da26574bf2f2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:31.760311 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d3750d43-6817-487e-bbcd-da26574bf2f2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:31.760753 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d3750d43-6817-487e-bbcd-da26574bf2f2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:31.761556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d3750d43-6817-487e-bbcd-da26574bf2f2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:31.761986 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d3750d43-6817-487e-bbcd-da26574bf2f2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:31.849237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-30dac185-84bc-4408-b65f-a5c284651aea tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:31.849916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-30dac185-84bc-4408-b65f-a5c284651aea tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:31.856499 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30dac185-84bc-4408-b65f-a5c284651aea tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:31.857009 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30dac185-84bc-4408-b65f-a5c284651aea tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:31.857833 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30dac185-84bc-4408-b65f-a5c284651aea tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:31.858318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30dac185-84bc-4408-b65f-a5c284651aea tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:31.906962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d3750d43-6817-487e-bbcd-da26574bf2f2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:31.915353 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d3750d43-6817-487e-bbcd-da26574bf2f2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.167637 Jun 29 08:37:31.915953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 173/361] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:31 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:31.996981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-30dac185-84bc-4408-b65f-a5c284651aea tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:32.004950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-30dac185-84bc-4408-b65f-a5c284651aea tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.159579 Jun 29 08:37:32.005434 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 189/362] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:31 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:32.458521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-08317ebb-063a-4417-93ba-9f73a3b9efa9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:32.459158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-08317ebb-063a-4417-93ba-9f73a3b9efa9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:32.465636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-08317ebb-063a-4417-93ba-9f73a3b9efa9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:32.466072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-08317ebb-063a-4417-93ba-9f73a3b9efa9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:32.466852 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-08317ebb-063a-4417-93ba-9f73a3b9efa9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:32.467271 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-08317ebb-063a-4417-93ba-9f73a3b9efa9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:32.611895 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-08317ebb-063a-4417-93ba-9f73a3b9efa9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:32.623619 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-08317ebb-063a-4417-93ba-9f73a3b9efa9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.168619 Jun 29 08:37:32.624318 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 174/363] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:32 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:32.937311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-576cd2ee-0eab-42d5-b073-bbc6668b6432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:32.939347 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-576cd2ee-0eab-42d5-b073-bbc6668b6432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:32.949634 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-576cd2ee-0eab-42d5-b073-bbc6668b6432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:32.950387 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-576cd2ee-0eab-42d5-b073-bbc6668b6432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:32.951704 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-576cd2ee-0eab-42d5-b073-bbc6668b6432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:32.952420 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-576cd2ee-0eab-42d5-b073-bbc6668b6432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:33.027560 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-86f5fae1-f65f-4bf7-a82f-7dbb1e11bf5e tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:33.028161 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-86f5fae1-f65f-4bf7-a82f-7dbb1e11bf5e tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:33.038220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-86f5fae1-f65f-4bf7-a82f-7dbb1e11bf5e tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:33.038839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-86f5fae1-f65f-4bf7-a82f-7dbb1e11bf5e tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:33.039635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-86f5fae1-f65f-4bf7-a82f-7dbb1e11bf5e tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:33.040240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-86f5fae1-f65f-4bf7-a82f-7dbb1e11bf5e tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:33.125079 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-576cd2ee-0eab-42d5-b073-bbc6668b6432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:33.134310 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-576cd2ee-0eab-42d5-b073-bbc6668b6432 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.204017 Jun 29 08:37:33.134894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 190/364] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:32 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:33.197369 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-86f5fae1-f65f-4bf7-a82f-7dbb1e11bf5e tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:33.208738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-86f5fae1-f65f-4bf7-a82f-7dbb1e11bf5e tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.186690 Jun 29 08:37:33.209459 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 175/365] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:33 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:33.644790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fca7ffc4-0d4c-42bd-bd3a-81b1ee7b70e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:33.645585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fca7ffc4-0d4c-42bd-bd3a-81b1ee7b70e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:33.654004 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fca7ffc4-0d4c-42bd-bd3a-81b1ee7b70e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:33.654582 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fca7ffc4-0d4c-42bd-bd3a-81b1ee7b70e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:33.655616 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fca7ffc4-0d4c-42bd-bd3a-81b1ee7b70e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:33.656174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fca7ffc4-0d4c-42bd-bd3a-81b1ee7b70e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:33.796277 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fca7ffc4-0d4c-42bd-bd3a-81b1ee7b70e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:33.804038 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fca7ffc4-0d4c-42bd-bd3a-81b1ee7b70e4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.165460 Jun 29 08:37:33.804607 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 191/366] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:33 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:34.153565 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-09d3ba00-3f46-4293-a659-74089b66614f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:34.154162 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-09d3ba00-3f46-4293-a659-74089b66614f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:34.161059 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09d3ba00-3f46-4293-a659-74089b66614f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:34.161499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09d3ba00-3f46-4293-a659-74089b66614f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:34.162246 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09d3ba00-3f46-4293-a659-74089b66614f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:34.162666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09d3ba00-3f46-4293-a659-74089b66614f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:34.225832 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d067e77d-6d54-46f5-9405-be8136fe0980 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:34.226429 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d067e77d-6d54-46f5-9405-be8136fe0980 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:34.232640 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d067e77d-6d54-46f5-9405-be8136fe0980 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:34.233084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d067e77d-6d54-46f5-9405-be8136fe0980 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:34.233875 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d067e77d-6d54-46f5-9405-be8136fe0980 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:34.234299 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d067e77d-6d54-46f5-9405-be8136fe0980 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:34.341849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-09d3ba00-3f46-4293-a659-74089b66614f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:34.350632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-09d3ba00-3f46-4293-a659-74089b66614f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.200778 Jun 29 08:37:34.359788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 176/367] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:34 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:34.389167 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d067e77d-6d54-46f5-9405-be8136fe0980 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:34.397292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d067e77d-6d54-46f5-9405-be8136fe0980 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.175333 Jun 29 08:37:34.397831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 192/368] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:34 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:34.825666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-82c8c5e0-aec9-4f6b-838f-ddb6c20e9f68 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:34.826654 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-82c8c5e0-aec9-4f6b-838f-ddb6c20e9f68 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:34.836932 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-82c8c5e0-aec9-4f6b-838f-ddb6c20e9f68 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:34.837651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-82c8c5e0-aec9-4f6b-838f-ddb6c20e9f68 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:34.838926 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-82c8c5e0-aec9-4f6b-838f-ddb6c20e9f68 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:34.839632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-82c8c5e0-aec9-4f6b-838f-ddb6c20e9f68 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:34.971219 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-82c8c5e0-aec9-4f6b-838f-ddb6c20e9f68 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:34.979280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-82c8c5e0-aec9-4f6b-838f-ddb6c20e9f68 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.160464 Jun 29 08:37:34.979816 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 177/369] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:34 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:35.367081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7afd3ffd-c224-48ef-956f-5fd8a591cfa1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:35.367863 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7afd3ffd-c224-48ef-956f-5fd8a591cfa1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:35.374007 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7afd3ffd-c224-48ef-956f-5fd8a591cfa1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:35.374524 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7afd3ffd-c224-48ef-956f-5fd8a591cfa1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:35.375391 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7afd3ffd-c224-48ef-956f-5fd8a591cfa1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:35.375883 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7afd3ffd-c224-48ef-956f-5fd8a591cfa1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:35.414426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7dbb7109-0bb4-4754-8a6b-33a0c2c036b8 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:35.415199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7dbb7109-0bb4-4754-8a6b-33a0c2c036b8 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:35.422255 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7dbb7109-0bb4-4754-8a6b-33a0c2c036b8 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:35.422793 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7dbb7109-0bb4-4754-8a6b-33a0c2c036b8 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:35.423767 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7dbb7109-0bb4-4754-8a6b-33a0c2c036b8 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:35.424775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7dbb7109-0bb4-4754-8a6b-33a0c2c036b8 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:35.580834 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7afd3ffd-c224-48ef-956f-5fd8a591cfa1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:35.592040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7afd3ffd-c224-48ef-956f-5fd8a591cfa1 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.229153 Jun 29 08:37:35.602062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 193/370] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:35 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:35.627218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7dbb7109-0bb4-4754-8a6b-33a0c2c036b8 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:35.635171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7dbb7109-0bb4-4754-8a6b-33a0c2c036b8 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.224552 Jun 29 08:37:35.635717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 178/371] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:35 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:35.997714 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4ed46b20-6fc5-4b75-b281-0d1f805d8fea tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:35.998422 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4ed46b20-6fc5-4b75-b281-0d1f805d8fea tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:36.006017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4ed46b20-6fc5-4b75-b281-0d1f805d8fea tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:36.006535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4ed46b20-6fc5-4b75-b281-0d1f805d8fea tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:36.007480 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4ed46b20-6fc5-4b75-b281-0d1f805d8fea tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:36.007978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4ed46b20-6fc5-4b75-b281-0d1f805d8fea tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:36.147289 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4ed46b20-6fc5-4b75-b281-0d1f805d8fea tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:36.155384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4ed46b20-6fc5-4b75-b281-0d1f805d8fea tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.162261 Jun 29 08:37:36.155948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 194/372] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:35 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:36.612995 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2138b4d0-e576-4965-8e44-d47f09884fea tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:36.613550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2138b4d0-e576-4965-8e44-d47f09884fea tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:36.620484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2138b4d0-e576-4965-8e44-d47f09884fea tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:36.620927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2138b4d0-e576-4965-8e44-d47f09884fea tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:36.621679 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2138b4d0-e576-4965-8e44-d47f09884fea tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:36.622088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2138b4d0-e576-4965-8e44-d47f09884fea tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:36.642061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:36.653385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-354f9f62-e8d4-45b3-af82-fa3c0f489181 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:36.662846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-354f9f62-e8d4-45b3-af82-fa3c0f489181 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:36.669515 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-354f9f62-e8d4-45b3-af82-fa3c0f489181 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:36.670036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-354f9f62-e8d4-45b3-af82-fa3c0f489181 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:36.670906 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-354f9f62-e8d4-45b3-af82-fa3c0f489181 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:36.671889 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-354f9f62-e8d4-45b3-af82-fa3c0f489181 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:36.812160 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2138b4d0-e576-4965-8e44-d47f09884fea tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:36.821334 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2138b4d0-e576-4965-8e44-d47f09884fea tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.214319 Jun 29 08:37:36.822982 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 179/373] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:36 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:36.858436 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-354f9f62-e8d4-45b3-af82-fa3c0f489181 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:36.864391 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:36.872892 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-354f9f62-e8d4-45b3-af82-fa3c0f489181 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1315 microversion: 2.1 time: 0.224415 Jun 29 08:37:36.873817 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 195/374] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:36 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:37.172673 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ac91e221-b609-4e01-a4d3-aa4c86cbad4e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:37.173187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ac91e221-b609-4e01-a4d3-aa4c86cbad4e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:37.180381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ac91e221-b609-4e01-a4d3-aa4c86cbad4e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:37.180830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ac91e221-b609-4e01-a4d3-aa4c86cbad4e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:37.181588 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ac91e221-b609-4e01-a4d3-aa4c86cbad4e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:37.181987 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ac91e221-b609-4e01-a4d3-aa4c86cbad4e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:37.323984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ac91e221-b609-4e01-a4d3-aa4c86cbad4e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:37.331921 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ac91e221-b609-4e01-a4d3-aa4c86cbad4e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.163457 Jun 29 08:37:37.332484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 180/375] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:37 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:37.839635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-be5ebb45-8229-4352-b394-9c924d9e13ac tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:37.840683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-be5ebb45-8229-4352-b394-9c924d9e13ac tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:37.842625 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:37.849051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be5ebb45-8229-4352-b394-9c924d9e13ac tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:37.849488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be5ebb45-8229-4352-b394-9c924d9e13ac tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:37.850248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be5ebb45-8229-4352-b394-9c924d9e13ac tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:37.850862 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be5ebb45-8229-4352-b394-9c924d9e13ac tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:37.897625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b42c4ee4-c0c6-49e3-8654-fcd8a1adb04b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:37.898209 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b42c4ee4-c0c6-49e3-8654-fcd8a1adb04b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:37.907488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b42c4ee4-c0c6-49e3-8654-fcd8a1adb04b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:37.908306 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b42c4ee4-c0c6-49e3-8654-fcd8a1adb04b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:37.910675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b42c4ee4-c0c6-49e3-8654-fcd8a1adb04b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:37.911233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b42c4ee4-c0c6-49e3-8654-fcd8a1adb04b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:38.169001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-be5ebb45-8229-4352-b394-9c924d9e13ac tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:38.177870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-be5ebb45-8229-4352-b394-9c924d9e13ac tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1553 microversion: 2.1 time: 0.342621 Jun 29 08:37:38.187538 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 196/376] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:37 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1553 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:38.211620 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b42c4ee4-c0c6-49e3-8654-fcd8a1adb04b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:38.223116 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b42c4ee4-c0c6-49e3-8654-fcd8a1adb04b tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1465 microversion: 2.1 time: 0.329420 Jun 29 08:37:38.224167 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 181/377] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:37 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1465 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:38.269527 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-946d5883-9ccb-4552-966a-b59048ec7000 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:38.270261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-946d5883-9ccb-4552-966a-b59048ec7000 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:38.276697 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-946d5883-9ccb-4552-966a-b59048ec7000 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:38.277261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-946d5883-9ccb-4552-966a-b59048ec7000 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:38.278122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-946d5883-9ccb-4552-966a-b59048ec7000 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:38.278788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-946d5883-9ccb-4552-966a-b59048ec7000 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:38.306939 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-946d5883-9ccb-4552-966a-b59048ec7000 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:37:38.350014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-aa0c971a-426a-4b0e-88d8-168864106cd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:38.350616 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-aa0c971a-426a-4b0e-88d8-168864106cd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:38.360594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=70 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:38.364733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aa0c971a-426a-4b0e-88d8-168864106cd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:38.366540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aa0c971a-426a-4b0e-88d8-168864106cd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:38.368296 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aa0c971a-426a-4b0e-88d8-168864106cd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:38.368721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aa0c971a-426a-4b0e-88d8-168864106cd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:38.434934 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-946d5883-9ccb-4552-966a-b59048ec7000 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 204 len: 0 microversion: 2.1 time: 0.169655 Jun 29 08:37:38.435694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 197/378] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:37:38 2022] DELETE /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:37:38.446815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-afa9f495-f7e6-474f-8138-c685e92f1e72 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:38.447790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-afa9f495-f7e6-474f-8138-c685e92f1e72 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:38.461385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-afa9f495-f7e6-474f-8138-c685e92f1e72 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:38.465679 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-afa9f495-f7e6-474f-8138-c685e92f1e72 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:38.466983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-afa9f495-f7e6-474f-8138-c685e92f1e72 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:38.467576 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-afa9f495-f7e6-474f-8138-c685e92f1e72 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:38.898781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-aa0c971a-426a-4b0e-88d8-168864106cd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:38.901493 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-afa9f495-f7e6-474f-8138-c685e92f1e72 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:38.907529 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-aa0c971a-426a-4b0e-88d8-168864106cd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1521 microversion: 2.1 time: 0.562163 Jun 29 08:37:38.908184 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 182/379] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:38 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:38.913027 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-589c5007-ecd9-4ff2-9571-1f67729a9406 req-e227508c-9709-4475-97c5-70f00edf1802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e23553-4467-4f79-969b-21758f4c244a", "name": "network-vif-deleted", "tag": "13059f8a-34b7-4a4a-a56b-e4bfe5599234"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:38.922176 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-afa9f495-f7e6-474f-8138-c685e92f1e72 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1471 microversion: 2.1 time: 0.481967 Jun 29 08:37:38.922591 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-589c5007-ecd9-4ff2-9571-1f67729a9406 req-e227508c-9709-4475-97c5-70f00edf1802 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:38.922860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 198/380] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:38 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1471 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:38.923635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-589c5007-ecd9-4ff2-9571-1f67729a9406 req-e227508c-9709-4475-97c5-70f00edf1802 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:38.935411 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-589c5007-ecd9-4ff2-9571-1f67729a9406 req-e227508c-9709-4475-97c5-70f00edf1802 service nova] Creating event network-vif-deleted:13059f8a-34b7-4a4a-a56b-e4bfe5599234 for instance 92e23553-4467-4f79-969b-21758f4c244a on hv-cinder-79760 Jun 29 08:37:38.940433 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-589c5007-ecd9-4ff2-9571-1f67729a9406 req-e227508c-9709-4475-97c5-70f00edf1802 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030787 Jun 29 08:37:38.941519 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 183/381] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:39.195094 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cb29c0ef-624b-4cfd-a5f8-9409731e3aaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:39.195731 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cb29c0ef-624b-4cfd-a5f8-9409731e3aaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:39.202592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb29c0ef-624b-4cfd-a5f8-9409731e3aaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:39.203067 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb29c0ef-624b-4cfd-a5f8-9409731e3aaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:39.204015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb29c0ef-624b-4cfd-a5f8-9409731e3aaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:39.204595 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb29c0ef-624b-4cfd-a5f8-9409731e3aaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:39.275393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cb29c0ef-624b-4cfd-a5f8-9409731e3aaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:39.286208 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cb29c0ef-624b-4cfd-a5f8-9409731e3aaf tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1511 microversion: 2.1 time: 0.094847 Jun 29 08:37:39.287087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 199/382] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:39 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:39.928354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-27c4c6bc-48f3-4dd2-a068-d67d3104d6cf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:39.929179 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-27c4c6bc-48f3-4dd2-a068-d67d3104d6cf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:39.942769 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3e47145c-6745-41c5-9c67-c77cafa2f206 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:39.943944 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3e47145c-6745-41c5-9c67-c77cafa2f206 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:39.950681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e47145c-6745-41c5-9c67-c77cafa2f206 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:39.951089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-27c4c6bc-48f3-4dd2-a068-d67d3104d6cf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:39.951203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e47145c-6745-41c5-9c67-c77cafa2f206 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:39.951714 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-27c4c6bc-48f3-4dd2-a068-d67d3104d6cf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:39.951923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e47145c-6745-41c5-9c67-c77cafa2f206 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:39.952345 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e47145c-6745-41c5-9c67-c77cafa2f206 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:39.954796 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-27c4c6bc-48f3-4dd2-a068-d67d3104d6cf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:39.955555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-27c4c6bc-48f3-4dd2-a068-d67d3104d6cf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:40.196136 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e47145c-6745-41c5-9c67-c77cafa2f206 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:40.209219 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3e47145c-6745-41c5-9c67-c77cafa2f206 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1471 microversion: 2.1 time: 0.271557 Jun 29 08:37:40.210055 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 200/383] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:39 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:40.229585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-27c4c6bc-48f3-4dd2-a068-d67d3104d6cf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:40.236966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-27c4c6bc-48f3-4dd2-a068-d67d3104d6cf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1501 microversion: 2.1 time: 0.315792 Jun 29 08:37:40.237523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 184/384] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:39 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:40.253758 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ed49af3a-7441-48dc-96bd-89329a5c6e9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:40.254469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ed49af3a-7441-48dc-96bd-89329a5c6e9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:40.261388 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed49af3a-7441-48dc-96bd-89329a5c6e9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:40.261943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed49af3a-7441-48dc-96bd-89329a5c6e9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:40.262722 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed49af3a-7441-48dc-96bd-89329a5c6e9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:40.263155 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed49af3a-7441-48dc-96bd-89329a5c6e9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:40.307747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3b793396-118b-4609-8a95-6eb2a4803d7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:40.309902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3b793396-118b-4609-8a95-6eb2a4803d7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:40.323774 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3b793396-118b-4609-8a95-6eb2a4803d7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:40.324313 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3b793396-118b-4609-8a95-6eb2a4803d7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:40.325332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3b793396-118b-4609-8a95-6eb2a4803d7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:40.325923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3b793396-118b-4609-8a95-6eb2a4803d7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:40.415728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3b793396-118b-4609-8a95-6eb2a4803d7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:40.423658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3b793396-118b-4609-8a95-6eb2a4803d7c tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1511 microversion: 2.1 time: 0.123482 Jun 29 08:37:40.425131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 185/385] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:40 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1511 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:40.478376 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ed49af3a-7441-48dc-96bd-89329a5c6e9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:40.491115 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ed49af3a-7441-48dc-96bd-89329a5c6e9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1516 microversion: 2.1 time: 0.241878 Jun 29 08:37:40.491949 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 201/386] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:40 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:41.229335 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a0598711-c2e7-440f-a5bb-3477ccd37453 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:41.230059 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a0598711-c2e7-440f-a5bb-3477ccd37453 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:41.239050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a0598711-c2e7-440f-a5bb-3477ccd37453 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:41.239554 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a0598711-c2e7-440f-a5bb-3477ccd37453 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:41.240373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a0598711-c2e7-440f-a5bb-3477ccd37453 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:41.240957 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a0598711-c2e7-440f-a5bb-3477ccd37453 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:41.401104 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a0598711-c2e7-440f-a5bb-3477ccd37453 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:41.409177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a0598711-c2e7-440f-a5bb-3477ccd37453 tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1471 microversion: 2.1 time: 0.184831 Jun 29 08:37:41.409848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 186/387] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:41 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:41.440770 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:41.441436 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:41.447519 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:41.448217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:41.448979 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:41.449409 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:41.484357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:41.484788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:41.485394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lazy-loading 'fault' on Instance uuid 92e23553-4467-4f79-969b-21758f4c244a {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:37:41.543956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55c898180bd4cbf910f3d92045e7d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50fef9e1824a2c918d9649f226364d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:41.559385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-783752f4-c5b9-4c59-86cd-83840fb435c2 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 200 len: 1351 microversion: 2.1 time: 0.122377 Jun 29 08:37:41.559978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 202/388] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:41 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:42.427003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-50c6fbac-6c01-4200-b2cd-fa5ed7fe420f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:42.427710 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-50c6fbac-6c01-4200-b2cd-fa5ed7fe420f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:42.428552 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-b2be510e-85b2-407f-97f2-cb18c9acf342 req-70f76bf7-f85d-4239-b628-c180f3165938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2001924-095f-4982-b35b-843f5d93cfd2", "name": "network-vif-deleted", "tag": "9fe93f20-f712-4fed-8f97-2586554fad6c"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:42.437959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50c6fbac-6c01-4200-b2cd-fa5ed7fe420f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:42.438558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50c6fbac-6c01-4200-b2cd-fa5ed7fe420f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:42.439598 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50c6fbac-6c01-4200-b2cd-fa5ed7fe420f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:42.440414 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50c6fbac-6c01-4200-b2cd-fa5ed7fe420f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:42.442797 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b2be510e-85b2-407f-97f2-cb18c9acf342 req-70f76bf7-f85d-4239-b628-c180f3165938 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:42.443811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b2be510e-85b2-407f-97f2-cb18c9acf342 req-70f76bf7-f85d-4239-b628-c180f3165938 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:42.460471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-b2be510e-85b2-407f-97f2-cb18c9acf342 req-70f76bf7-f85d-4239-b628-c180f3165938 service nova] Creating event network-vif-deleted:9fe93f20-f712-4fed-8f97-2586554fad6c for instance b2001924-095f-4982-b35b-843f5d93cfd2 on hv-cinder-79760 Jun 29 08:37:42.467367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-b2be510e-85b2-407f-97f2-cb18c9acf342 req-70f76bf7-f85d-4239-b628-c180f3165938 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043173 Jun 29 08:37:42.468344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 203/389] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:42.520501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-50c6fbac-6c01-4200-b2cd-fa5ed7fe420f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac61282884a54556bb611c59c30d75a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3faae8ed99784a52b784c22e77de9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:42.528401 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-50c6fbac-6c01-4200-b2cd-fa5ed7fe420f tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 200 len: 1429 microversion: 2.1 time: 0.105896 Jun 29 08:37:42.528972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 187/390] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:42 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:42.579523 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:42.580227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:42.588902 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:42.589459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:42.590581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:42.591028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:42.609746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] HTTP exception thrown: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Request method failure captured: Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a HTTP/1.1 Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7D00JCqbBrNr6t6VgiG-K1a75GTJqrVF5RcBYiFzIVOGyPnzd6k_lbAF0AA9_BV6U56anOL4PRiUM-Ld0mTizxD7GPlqY2Sm5Hrjfh06Bz7KI5smpPQwPVM8ce9PCS1J-hZRQ7XjCuepsAoE4TLz-BY00yZbsn593u33RURR6In9w Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: ed50fef9e1824a2c918d9649f226364d Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:37:42.621467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed50fef9e1824a2c918d9649f226364d"}]}] Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: ed50fef9e1824a2c918d9649f226364d Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-DeleteServersTestJSON-334665366-project Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: d55c898180bd4cbf910f3d92045e7d67 Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-DeleteServersTestJSON-334665366-project Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.622755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '92e23553-4467-4f79-969b-21758f4c244a'} Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:37:42.623713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.625082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.626370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Returning 404 to user: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:37:42.626370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5f534bb1-7fa4-4520-9a99-cb30b6956d97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 404 len: 111 microversion: 2.1 time: 0.051129 Jun 29 08:37:42.626370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 204/391] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:42 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:37:42.737519 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:42.738503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:42.744619 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:42.745058 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:42.745809 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:42.746232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:42.759225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] HTTP exception thrown: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Request method failure captured: Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a/os-volume_attachments HTTP/1.1 Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7D00JCqbBrNr6t6VgiG-K1a75GTJqrVF5RcBYiFzIVOGyPnzd6k_lbAF0AA9_BV6U56anOL4PRiUM-Ld0mTizxD7GPlqY2Sm5Hrjfh06Bz7KI5smpPQwPVM8ce9PCS1J-hZRQ7XjCuepsAoE4TLz-BY00yZbsn593u33RURR6In9w Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: ed50fef9e1824a2c918d9649f226364d Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:37:42.770728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed50fef9e1824a2c918d9649f226364d"}]}] Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: ed50fef9e1824a2c918d9649f226364d Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-DeleteServersTestJSON-334665366-project Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: d55c898180bd4cbf910f3d92045e7d67 Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-DeleteServersTestJSON-334665366-project Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.772024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'server_id': '92e23553-4467-4f79-969b-21758f4c244a'} Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:37:42.772667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:42.774148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:42.775566 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Returning 404 to user: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:37:42.775566 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2c624e67-d1b9-4240-8010-75dd0c1f260f tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038963 Jun 29 08:37:42.775566 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 188/392] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:37:42 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:37:43.058365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b2e33eca-465e-4e58-a138-c67fe0dfc4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:43.059439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b2e33eca-465e-4e58-a138-c67fe0dfc4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:43.067306 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2e33eca-465e-4e58-a138-c67fe0dfc4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:43.067790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2e33eca-465e-4e58-a138-c67fe0dfc4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:43.068737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2e33eca-465e-4e58-a138-c67fe0dfc4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:43.069229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2e33eca-465e-4e58-a138-c67fe0dfc4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:43.095229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-b2e33eca-465e-4e58-a138-c67fe0dfc4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lazy-loading 'flavor' on Instance uuid b8f1f6d1-d03f-4304-b607-4ea8870be425 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:37:43.176887 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b2e33eca-465e-4e58-a138-c67fe0dfc4a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425/action" status: 200 len: 32 microversion: 2.1 time: 0.123044 Jun 29 08:37:43.177467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 205/393] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:37:43 2022] POST /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:37:43.186659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-fa049fc8-e9c1-4e05-b2e8-af9dcda81cb2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:43.187376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fa049fc8-e9c1-4e05-b2e8-af9dcda81cb2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:43.194282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fa049fc8-e9c1-4e05-b2e8-af9dcda81cb2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:43.194912 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fa049fc8-e9c1-4e05-b2e8-af9dcda81cb2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:43.195938 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fa049fc8-e9c1-4e05-b2e8-af9dcda81cb2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:43.196442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fa049fc8-e9c1-4e05-b2e8-af9dcda81cb2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:43.430072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-fa049fc8-e9c1-4e05-b2e8-af9dcda81cb2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:43.438623 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-fa049fc8-e9c1-4e05-b2e8-af9dcda81cb2 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.255991 Jun 29 08:37:43.439591 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 189/394] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:43 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:43.546284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:43.547002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] [instance: b2001924-095f-4982-b35b-843f5d93cfd2] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:43.554230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:43.554677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:43.555635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:43.556142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:43.570571 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] HTTP exception thrown: Instance b2001924-095f-4982-b35b-843f5d93cfd2 could not be found. Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Request method failure captured: Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 HTTP/1.1 Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA8wLlbl9y4v5Um_C3sWn4fVkdJ1DYJZcapjF9BJqodupDMY5vkvLJ_a1I3EdNoq5Kq6uR3GNvy1QDxDqj98SSqeq5bq2Ty0Bb7l6e9ZY0savKjSBmkN3mtxXc6wECGWVlEMgERsIrgJZbr-wDbQKdouBAOD1CdWQr4CzrOTIrYINbg Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 3faae8ed99784a52b784c22e77de9890 Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-1351364236 Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:37:43.572301 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3faae8ed99784a52b784c22e77de9890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3faae8ed99784a52b784c22e77de9890"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3faae8ed99784a52b784c22e77de9890"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3faae8ed99784a52b784c22e77de9890"}]}] Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-1351364236 Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 3faae8ed99784a52b784c22e77de9890 Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-1351364236 Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-1351364236-project Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: ac61282884a54556bb611c59c30d75a2 Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-1351364236-project Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance b2001924-095f-4982-b35b-843f5d93cfd2 could not be found. Jun 29 08:37:43.573444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'b2001924-095f-4982-b35b-843f5d93cfd2'} Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2001924-095f-4982-b35b-843f5d93cfd2 could not be found. Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:37:43.574116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2001924-095f-4982-b35b-843f5d93cfd2 could not be found. Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2001924-095f-4982-b35b-843f5d93cfd2 could not be found. Jun 29 08:37:43.575183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:43.576112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] Returning 404 to user: Instance b2001924-095f-4982-b35b-843f5d93cfd2 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:37:43.576112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a09dda23-b27a-4188-a477-dc346bccb06a tempest-VolumesNegativeTest-1351364236 tempest-VolumesNegativeTest-1351364236-project] 10.222.0.27 "GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2" status: 404 len: 111 microversion: 2.1 time: 0.031804 Jun 29 08:37:43.576112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 206/395] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:43 2022] GET /compute/v2.1/servers/b2001924-095f-4982-b35b-843f5d93cfd2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:37:44.456240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-39f9420e-bfec-4ad6-a40f-4deb9376b8f8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:44.456834 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-39f9420e-bfec-4ad6-a40f-4deb9376b8f8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:44.464162 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39f9420e-bfec-4ad6-a40f-4deb9376b8f8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:44.464310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39f9420e-bfec-4ad6-a40f-4deb9376b8f8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:44.465606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39f9420e-bfec-4ad6-a40f-4deb9376b8f8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:44.466025 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39f9420e-bfec-4ad6-a40f-4deb9376b8f8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:44.617340 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-39f9420e-bfec-4ad6-a40f-4deb9376b8f8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:44.626102 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-39f9420e-bfec-4ad6-a40f-4deb9376b8f8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.173143 Jun 29 08:37:44.626270 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 190/396] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:44 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:45.130582 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:45.131773 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:45.139724 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:45.140265 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:45.141066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:45.141783 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:45.156841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] HTTP exception thrown: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Request method failure captured: Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a HTTP/1.1 Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7D00JCqbBrNr6t6VgiG-K1a75GTJqrVF5RcBYiFzIVOGyPnzd6k_lbAF0AA9_BV6U56anOL4PRiUM-Ld0mTizxD7GPlqY2Sm5Hrjfh06Bz7KI5smpPQwPVM8ce9PCS1J-hZRQ7XjCuepsAoE4TLz-BY00yZbsn593u33RURR6In9w Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: ed50fef9e1824a2c918d9649f226364d Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:37:45.158344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed50fef9e1824a2c918d9649f226364d"}]}] Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: ed50fef9e1824a2c918d9649f226364d Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-DeleteServersTestJSON-334665366-project Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: d55c898180bd4cbf910f3d92045e7d67 Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-DeleteServersTestJSON-334665366-project Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.160305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '92e23553-4467-4f79-969b-21758f4c244a'} Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:37:45.161047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.162458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.164101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Returning 404 to user: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:37:45.164101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4cc869a7-d722-49be-af75-8fa1016cdfd8 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 404 len: 111 microversion: 2.1 time: 0.033599 Jun 29 08:37:45.164101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 207/397] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:37:45 2022] DELETE /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:37:45.170497 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:45.171133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] [instance: 92e23553-4467-4f79-969b-21758f4c244a] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:45.177393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:45.177832 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:45.178588 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:45.179034 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:45.194639 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] HTTP exception thrown: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Request method failure captured: Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a HTTP/1.1 Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7D00JCqbBrNr6t6VgiG-K1a75GTJqrVF5RcBYiFzIVOGyPnzd6k_lbAF0AA9_BV6U56anOL4PRiUM-Ld0mTizxD7GPlqY2Sm5Hrjfh06Bz7KI5smpPQwPVM8ce9PCS1J-hZRQ7XjCuepsAoE4TLz-BY00yZbsn593u33RURR6In9w Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: ed50fef9e1824a2c918d9649f226364d Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:37:45.197131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed50fef9e1824a2c918d9649f226364d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed50fef9e1824a2c918d9649f226364d"}]}] Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: ed50fef9e1824a2c918d9649f226364d Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-DeleteServersTestJSON-334665366 Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-DeleteServersTestJSON-334665366-project Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: d55c898180bd4cbf910f3d92045e7d67 Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-DeleteServersTestJSON-334665366-project Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.198584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '92e23553-4467-4f79-969b-21758f4c244a'} Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:37:45.199556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. Jun 29 08:37:45.200964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:37:45.202142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] Returning 404 to user: Instance 92e23553-4467-4f79-969b-21758f4c244a could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:37:45.202142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0d53157d-98f2-4d22-9410-5c7ba005ef97 tempest-DeleteServersTestJSON-334665366 tempest-DeleteServersTestJSON-334665366-project] 10.222.0.27 "GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a" status: 404 len: 111 microversion: 2.1 time: 0.035473 Jun 29 08:37:45.203110 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 191/398] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:45 2022] GET /compute/v2.1/servers/92e23553-4467-4f79-969b-21758f4c244a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:37:45.643012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-db3d3a9b-87bf-465c-a13f-7c2750661725 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:45.645012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-db3d3a9b-87bf-465c-a13f-7c2750661725 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:45.651631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db3d3a9b-87bf-465c-a13f-7c2750661725 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:45.652077 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db3d3a9b-87bf-465c-a13f-7c2750661725 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:45.652842 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db3d3a9b-87bf-465c-a13f-7c2750661725 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:45.653270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db3d3a9b-87bf-465c-a13f-7c2750661725 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:45.901314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-db3d3a9b-87bf-465c-a13f-7c2750661725 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:45.909408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-db3d3a9b-87bf-465c-a13f-7c2750661725 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.269855 Jun 29 08:37:45.910544 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 208/399] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:45 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:46.927873 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-be6b1a89-513b-4fb0-8f1d-06758b953baf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:46.928915 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-be6b1a89-513b-4fb0-8f1d-06758b953baf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:46.938448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be6b1a89-513b-4fb0-8f1d-06758b953baf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:46.938926 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be6b1a89-513b-4fb0-8f1d-06758b953baf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:46.939713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be6b1a89-513b-4fb0-8f1d-06758b953baf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:46.940149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be6b1a89-513b-4fb0-8f1d-06758b953baf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:47.123001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-be6b1a89-513b-4fb0-8f1d-06758b953baf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:47.135455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-be6b1a89-513b-4fb0-8f1d-06758b953baf tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.211704 Jun 29 08:37:47.136159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 192/400] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:46 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:48.152719 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-08cc9fc6-3901-44bd-aed0-18ce3947e72b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:48.153310 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-08cc9fc6-3901-44bd-aed0-18ce3947e72b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:48.159836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08cc9fc6-3901-44bd-aed0-18ce3947e72b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:48.160440 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08cc9fc6-3901-44bd-aed0-18ce3947e72b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:48.161217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08cc9fc6-3901-44bd-aed0-18ce3947e72b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:48.161659 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08cc9fc6-3901-44bd-aed0-18ce3947e72b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:48.375981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-08cc9fc6-3901-44bd-aed0-18ce3947e72b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:48.389428 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-08cc9fc6-3901-44bd-aed0-18ce3947e72b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.240659 Jun 29 08:37:48.390015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 209/401] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:48 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:49.406471 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8ba045e3-841e-4569-819b-489b1a10b9f6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:49.407238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8ba045e3-841e-4569-819b-489b1a10b9f6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:49.420442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8ba045e3-841e-4569-819b-489b1a10b9f6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:49.420935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8ba045e3-841e-4569-819b-489b1a10b9f6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:49.421707 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8ba045e3-841e-4569-819b-489b1a10b9f6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:49.422141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8ba045e3-841e-4569-819b-489b1a10b9f6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:49.568550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8ba045e3-841e-4569-819b-489b1a10b9f6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:49.584194 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8ba045e3-841e-4569-819b-489b1a10b9f6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.181454 Jun 29 08:37:49.585220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 193/402] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:49 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:50.297946 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-445ce7a9-e6e7-4295-b4e1-121392ef8d19 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Action: 'create', calling method: .version_select at 0x7fade42423a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-824855999"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:50.601669 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-66d47edd-cb1e-4b5e-80da-09b394190f26 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:50.604823 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-445ce7a9-e6e7-4295-b4e1-121392ef8d19 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.439698 Jun 29 08:37:50.605242 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-66d47edd-cb1e-4b5e-80da-09b394190f26 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:50.620088 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 210/403] 10.222.0.27 () {60 vars in 1154 bytes} [Wed Jun 29 08:37:50 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 447 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 08:37:50.620751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66d47edd-cb1e-4b5e-80da-09b394190f26 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:50.620751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66d47edd-cb1e-4b5e-80da-09b394190f26 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:50.620751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66d47edd-cb1e-4b5e-80da-09b394190f26 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:50.620751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66d47edd-cb1e-4b5e-80da-09b394190f26 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:50.626054 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f6889629-f350-467e-a5d3-f8703774d727 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247310>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:50.675902 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f6889629-f350-467e-a5d3-f8703774d727 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.053646 Jun 29 08:37:50.676567 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 211/404] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:37:50 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:50.777750 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-66d47edd-cb1e-4b5e-80da-09b394190f26 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:50.786525 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-66d47edd-cb1e-4b5e-80da-09b394190f26 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.188761 Jun 29 08:37:50.787332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 194/405] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:50 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:37:51.692937 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-40327b8f-f006-4a2e-8051-3320fb36ee58 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42473a0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:51.748427 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-40327b8f-f006-4a2e-8051-3320fb36ee58 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.062146 Jun 29 08:37:51.748983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 212/406] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:37:51 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:51.808343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5dd7dd99-bf9b-4ac9-a12e-81684be3b43f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:51.808929 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5dd7dd99-bf9b-4ac9-a12e-81684be3b43f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:51.816188 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5dd7dd99-bf9b-4ac9-a12e-81684be3b43f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:51.816625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5dd7dd99-bf9b-4ac9-a12e-81684be3b43f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:51.817382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5dd7dd99-bf9b-4ac9-a12e-81684be3b43f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:51.817806 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5dd7dd99-bf9b-4ac9-a12e-81684be3b43f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:51.959532 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5dd7dd99-bf9b-4ac9-a12e-81684be3b43f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:51.967550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5dd7dd99-bf9b-4ac9-a12e-81684be3b43f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.163076 Jun 29 08:37:51.968089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 195/407] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:51 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:52.764948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3921b82b-6edd-4e02-ab50-f1733c493904 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42a0ee0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:52.820639 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3921b82b-6edd-4e02-ab50-f1733c493904 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.062166 Jun 29 08:37:52.821201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 213/408] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:37:52 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:52.988837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-053c6e58-4e5d-439f-aa72-e96996c99203 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:52.989726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-053c6e58-4e5d-439f-aa72-e96996c99203 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:52.997484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-053c6e58-4e5d-439f-aa72-e96996c99203 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:52.998003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-053c6e58-4e5d-439f-aa72-e96996c99203 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:52.998931 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-053c6e58-4e5d-439f-aa72-e96996c99203 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:52.999445 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-053c6e58-4e5d-439f-aa72-e96996c99203 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:53.136975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-053c6e58-4e5d-439f-aa72-e96996c99203 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:53.145159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-053c6e58-4e5d-439f-aa72-e96996c99203 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.162624 Jun 29 08:37:53.146070 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 196/409] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:52 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:53.836147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7b96fd2a-dab5-4687-b641-ac6757d49734 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42474c0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:53.887397 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7b96fd2a-dab5-4687-b641-ac6757d49734 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.056155 Jun 29 08:37:53.888033 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 214/410] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:37:53 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:54.165761 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6b500d5e-4fa0-4385-95a4-4721fc7ff2d7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:54.166514 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6b500d5e-4fa0-4385-95a4-4721fc7ff2d7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:54.174558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6b500d5e-4fa0-4385-95a4-4721fc7ff2d7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:54.175152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6b500d5e-4fa0-4385-95a4-4721fc7ff2d7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:54.176135 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6b500d5e-4fa0-4385-95a4-4721fc7ff2d7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:54.176701 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6b500d5e-4fa0-4385-95a4-4721fc7ff2d7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:54.314446 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6b500d5e-4fa0-4385-95a4-4721fc7ff2d7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:54.322443 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6b500d5e-4fa0-4385-95a4-4721fc7ff2d7 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.162453 Jun 29 08:37:54.323052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 197/411] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:54 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:54.900358 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d6b56296-6f2a-46f7-a3d4-f84c8546819c tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247af0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:54.951434 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d6b56296-6f2a-46f7-a3d4-f84c8546819c tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.055409 Jun 29 08:37:54.952129 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 215/412] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:37:54 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:55.341542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dba6f1e1-d0fe-48d8-bfab-e16764d323b1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:55.342115 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-dba6f1e1-d0fe-48d8-bfab-e16764d323b1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:55.349176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dba6f1e1-d0fe-48d8-bfab-e16764d323b1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:55.349613 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dba6f1e1-d0fe-48d8-bfab-e16764d323b1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:55.350419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dba6f1e1-d0fe-48d8-bfab-e16764d323b1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:55.351126 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dba6f1e1-d0fe-48d8-bfab-e16764d323b1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:55.355293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:55.488462 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dba6f1e1-d0fe-48d8-bfab-e16764d323b1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:55.496952 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dba6f1e1-d0fe-48d8-bfab-e16764d323b1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.159950 Jun 29 08:37:55.497561 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 198/413] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:55 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:55.965996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-478a307c-f038-4cfd-9645-bb33d2f20e1f tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247700>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:56.015285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-478a307c-f038-4cfd-9645-bb33d2f20e1f tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.053732 Jun 29 08:37:56.015847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 216/414] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:37:55 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:56.515649 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-12d66bfc-10a2-47a1-97a1-edd1acee581d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:56.516200 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-12d66bfc-10a2-47a1-97a1-edd1acee581d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:56.524293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12d66bfc-10a2-47a1-97a1-edd1acee581d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:56.524750 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12d66bfc-10a2-47a1-97a1-edd1acee581d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:56.525593 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12d66bfc-10a2-47a1-97a1-edd1acee581d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:56.526051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12d66bfc-10a2-47a1-97a1-edd1acee581d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:56.688691 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-12d66bfc-10a2-47a1-97a1-edd1acee581d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:56.696793 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-12d66bfc-10a2-47a1-97a1-edd1acee581d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.185588 Jun 29 08:37:56.697355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 199/415] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:56 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:57.027736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f616cb6d-f15e-4ffa-a0ba-b90b2b4c1a80 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42421f0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:57.076430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f616cb6d-f15e-4ffa-a0ba-b90b2b4c1a80 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 345 microversion: 2.1 time: 0.052859 Jun 29 08:37:57.076988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 217/416] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:37:57 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:57.088341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-04c4eecd-e4fb-4379-88b5-f616b4db1c92 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Action: 'create', calling method: .version_select at 0x7fade429f430>, body: {"snapshot": {"volume_id": "8681a617-5c06-4987-a7af-a2e0ca378882", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-77130950"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:37:57.268097 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-04c4eecd-e4fb-4379-88b5-f616b4db1c92 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.183630 Jun 29 08:37:57.268925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 200/417] 10.222.0.27 () {60 vars in 1161 bytes} [Wed Jun 29 08:37:57 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:37:57.279651 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dbfc8c1a-9774-42cf-844a-60249e6251be tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247c10>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:57.312303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dbfc8c1a-9774-42cf-844a-60249e6251be tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.036847 Jun 29 08:37:57.313120 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 218/418] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:37:57 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:57.323715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-08d62ebf-a7fc-4337-a898-c5aeeec5cc67 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4356f70>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:57.353118 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-08d62ebf-a7fc-4337-a898-c5aeeec5cc67 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.033742 Jun 29 08:37:57.353680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 201/419] 10.222.0.27 () {58 vars in 1139 bytes} [Wed Jun 29 08:37:57 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:57.364230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c8373895-5819-47ef-ab15-c41581f1f76e tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247b80>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:57.394216 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c8373895-5819-47ef-ab15-c41581f1f76e tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.033976 Jun 29 08:37:57.394815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 219/420] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:37:57 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:57.715600 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-44f20b09-8628-41da-ac04-c4c2c96d8a16 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:57.716160 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-44f20b09-8628-41da-ac04-c4c2c96d8a16 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:57.722972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-44f20b09-8628-41da-ac04-c4c2c96d8a16 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:57.723395 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-44f20b09-8628-41da-ac04-c4c2c96d8a16 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:57.724354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-44f20b09-8628-41da-ac04-c4c2c96d8a16 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:57.724915 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-44f20b09-8628-41da-ac04-c4c2c96d8a16 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:57.857198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-44f20b09-8628-41da-ac04-c4c2c96d8a16 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:57.865774 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-44f20b09-8628-41da-ac04-c4c2c96d8a16 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.155753 Jun 29 08:37:57.866375 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 202/421] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:57 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:58.403903 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:58.404697 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:37:58.409094 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-49cd44d6-de93-4fbb-9763-3da62d5588ad tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42a0c10>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:58.441571 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-49cd44d6-de93-4fbb-9763-3da62d5588ad tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.038461 Jun 29 08:37:58.442326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 220/422] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:37:58 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:37:58.883256 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5c36553e-6645-4394-995b-56a8dc233f03 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:58.883903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5c36553e-6645-4394-995b-56a8dc233f03 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:37:58.892294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c36553e-6645-4394-995b-56a8dc233f03 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:58.892732 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c36553e-6645-4394-995b-56a8dc233f03 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:58.893557 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c36553e-6645-4394-995b-56a8dc233f03 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:37:58.893963 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c36553e-6645-4394-995b-56a8dc233f03 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:37:59.035055 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5c36553e-6645-4394-995b-56a8dc233f03 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:37:59.044373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5c36553e-6645-4394-995b-56a8dc233f03 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.165356 Jun 29 08:37:59.044932 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 203/423] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:37:58 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:37:59.455680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6ae90ea8-aca3-4618-918a-d1700e2e9863 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42420d0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:37:59.493614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6ae90ea8-aca3-4618-918a-d1700e2e9863 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.043596 Jun 29 08:37:59.494273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 221/424] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:37:59 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:00.065240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-116a0ddc-3798-4818-aad4-4697ae958c62 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:00.066096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-116a0ddc-3798-4818-aad4-4697ae958c62 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:00.075620 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-116a0ddc-3798-4818-aad4-4697ae958c62 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:00.076062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-116a0ddc-3798-4818-aad4-4697ae958c62 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:00.076807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-116a0ddc-3798-4818-aad4-4697ae958c62 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:00.077236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-116a0ddc-3798-4818-aad4-4697ae958c62 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:00.212217 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-116a0ddc-3798-4818-aad4-4697ae958c62 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:00.220752 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-116a0ddc-3798-4818-aad4-4697ae958c62 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.162295 Jun 29 08:38:00.221315 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 204/425] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:00 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:00.505966 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6fee1546-7262-4449-9fa3-9b0bf6e3ca77 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42a0ee0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:00.535769 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6fee1546-7262-4449-9fa3-9b0bf6e3ca77 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.033805 Jun 29 08:38:00.536350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 222/426] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:00 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:01.237820 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-781bd036-518b-4da1-b71d-0c6c76e30f6c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:01.238376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-781bd036-518b-4da1-b71d-0c6c76e30f6c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:01.245509 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-781bd036-518b-4da1-b71d-0c6c76e30f6c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:01.245957 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-781bd036-518b-4da1-b71d-0c6c76e30f6c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:01.246797 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-781bd036-518b-4da1-b71d-0c6c76e30f6c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:01.247225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-781bd036-518b-4da1-b71d-0c6c76e30f6c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:01.383045 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-781bd036-518b-4da1-b71d-0c6c76e30f6c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:01.390998 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-781bd036-518b-4da1-b71d-0c6c76e30f6c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.157270 Jun 29 08:38:01.391557 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 205/427] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:01 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:01.548088 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9bbc7d5e-3fc6-4573-ae58-24c2880f2b26 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247430>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:01.579393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9bbc7d5e-3fc6-4573-ae58-24c2880f2b26 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.034829 Jun 29 08:38:01.580151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 223/428] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:01 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:02.413837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-34add230-499e-4def-8f7f-a262ab37c76b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:02.414821 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-34add230-499e-4def-8f7f-a262ab37c76b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:02.426127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-34add230-499e-4def-8f7f-a262ab37c76b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:02.426923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-34add230-499e-4def-8f7f-a262ab37c76b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:02.428178 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-34add230-499e-4def-8f7f-a262ab37c76b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:02.428902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-34add230-499e-4def-8f7f-a262ab37c76b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:02.589024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-34add230-499e-4def-8f7f-a262ab37c76b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:02.594084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f0252fe4-b306-4758-81ae-e032ac570593 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42470d0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:02.597450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-34add230-499e-4def-8f7f-a262ab37c76b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.190049 Jun 29 08:38:02.598011 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 206/429] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:02 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:02.623698 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f0252fe4-b306-4758-81ae-e032ac570593 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.033829 Jun 29 08:38:02.624309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 224/430] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:02 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:03.619786 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8636da04-9cd7-427a-a5b6-acfeead735dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:03.620772 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8636da04-9cd7-427a-a5b6-acfeead735dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:03.632530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8636da04-9cd7-427a-a5b6-acfeead735dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:03.633262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8636da04-9cd7-427a-a5b6-acfeead735dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:03.634501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8636da04-9cd7-427a-a5b6-acfeead735dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:03.635265 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8636da04-9cd7-427a-a5b6-acfeead735dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:03.639363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b2919792-2223-4d26-a393-abf71f2baa2c tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4242a60>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:03.669202 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b2919792-2223-4d26-a393-abf71f2baa2c tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.036221 Jun 29 08:38:03.669750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 225/431] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:03 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:03.765198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8636da04-9cd7-427a-a5b6-acfeead735dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:03.772705 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8636da04-9cd7-427a-a5b6-acfeead735dd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.160003 Jun 29 08:38:03.773236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 207/432] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:03 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:04.684806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-14b7ff80-b1c8-4718-b169-7febd64b1a8d tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42475e0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:04.718456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-14b7ff80-b1c8-4718-b169-7febd64b1a8d tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.039325 Jun 29 08:38:04.719267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 226/433] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:04 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:04.793140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-49bd908e-2321-421c-8a44-90588e5edb87 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:04.793749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-49bd908e-2321-421c-8a44-90588e5edb87 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:04.803490 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-49bd908e-2321-421c-8a44-90588e5edb87 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:04.804103 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-49bd908e-2321-421c-8a44-90588e5edb87 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:04.805237 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-49bd908e-2321-421c-8a44-90588e5edb87 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:04.805926 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-49bd908e-2321-421c-8a44-90588e5edb87 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:04.953966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-49bd908e-2321-421c-8a44-90588e5edb87 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:04.969039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-49bd908e-2321-421c-8a44-90588e5edb87 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.181543 Jun 29 08:38:04.969540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 208/434] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:04 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:05.734275 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2f551740-8f36-42a9-ad64-0eb51b11bef7 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247f70>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:05.764354 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2f551740-8f36-42a9-ad64-0eb51b11bef7 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.036488 Jun 29 08:38:05.765226 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 227/435] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:05 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:05.985658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5eb74a1a-3542-40bd-b86a-4e3e28c4bcf5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:05.986252 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5eb74a1a-3542-40bd-b86a-4e3e28c4bcf5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:05.993392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5eb74a1a-3542-40bd-b86a-4e3e28c4bcf5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:05.993838 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5eb74a1a-3542-40bd-b86a-4e3e28c4bcf5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:05.994596 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5eb74a1a-3542-40bd-b86a-4e3e28c4bcf5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:05.995043 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5eb74a1a-3542-40bd-b86a-4e3e28c4bcf5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:06.133586 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5eb74a1a-3542-40bd-b86a-4e3e28c4bcf5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:06.141404 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5eb74a1a-3542-40bd-b86a-4e3e28c4bcf5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.159995 Jun 29 08:38:06.141998 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 209/436] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:05 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:06.780888 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e19fb4ab-63ff-42b3-9c9d-9ecec45b69a3 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade45c0f70>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:06.811983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e19fb4ab-63ff-42b3-9c9d-9ecec45b69a3 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 286 microversion: 2.1 time: 0.037552 Jun 29 08:38:06.812547 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 228/437] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:06 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:06.822925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-818db72d-b2e5-40fe-88e1-1ad3f8f71a42 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4256820>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:06.884545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-818db72d-b2e5-40fe-88e1-1ad3f8f71a42 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 202 len: 0 microversion: 2.1 time: 0.065462 Jun 29 08:38:06.885113 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 210/438] 10.222.0.27 () {58 vars in 1253 bytes} [Wed Jun 29 08:38:06 2022] DELETE /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:38:06.893583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3a710cf4-8641-4095-a2a3-332ce29dd436 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42425e0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:06.923791 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3a710cf4-8641-4095-a2a3-332ce29dd436 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.034086 Jun 29 08:38:06.924321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 229/439] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:06 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:07.160293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1aaba2ad-48b6-4e94-97be-66db1929a074 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:07.160900 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1aaba2ad-48b6-4e94-97be-66db1929a074 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:07.167465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1aaba2ad-48b6-4e94-97be-66db1929a074 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:07.167893 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1aaba2ad-48b6-4e94-97be-66db1929a074 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:07.168642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1aaba2ad-48b6-4e94-97be-66db1929a074 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:07.169069 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1aaba2ad-48b6-4e94-97be-66db1929a074 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:07.307384 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1aaba2ad-48b6-4e94-97be-66db1929a074 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:07.315213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1aaba2ad-48b6-4e94-97be-66db1929a074 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.159842 Jun 29 08:38:07.315774 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 211/440] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:07 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:07.936199 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9ab2bff4-59cc-4f5f-b5f1-a1b19370c4e2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42a0f70>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:07.967785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9ab2bff4-59cc-4f5f-b5f1-a1b19370c4e2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 200 len: 285 microversion: 2.1 time: 0.035570 Jun 29 08:38:07.968357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 230/441] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:07 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:08.333280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7b8374bd-8acd-4c41-9cd4-6ddfd537a2ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:08.333878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7b8374bd-8acd-4c41-9cd4-6ddfd537a2ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:08.340840 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7b8374bd-8acd-4c41-9cd4-6ddfd537a2ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:08.341275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7b8374bd-8acd-4c41-9cd4-6ddfd537a2ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:08.342020 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7b8374bd-8acd-4c41-9cd4-6ddfd537a2ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:08.342443 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7b8374bd-8acd-4c41-9cd4-6ddfd537a2ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:08.477328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7b8374bd-8acd-4c41-9cd4-6ddfd537a2ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:08.485138 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7b8374bd-8acd-4c41-9cd4-6ddfd537a2ce tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.156692 Jun 29 08:38:08.485949 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 212/442] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:08 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:38:08.984473 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0d6a3ba5-eb3b-4f32-af46-61d3683d9421 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247700>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:09.010727 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-0d6a3ba5-eb3b-4f32-af46-61d3683d9421 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] HTTP exception thrown: Snapshot dacf7ae1-bb50-48dd-8039-37f6c7c1e410 could not be found. Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0d6a3ba5-eb3b-4f32-af46-61d3683d9421 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Request method failure captured: Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 HTTP/1.1 Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA9eUpxvWe9TwUwmCTXrcae-V0abRRHj-cLc9dpjIyeVLYzQoqNn7xLQgJW8uHp-iIAitF8kTxv9SeDhUE1oLDIww7re6E3o5M51VsvC7v2187R2_Q6vRLQR4GZXdZSZnye04eFa19hSBBRWSvyo9PF4HOKRWJyavRg0uYdt8VSTA_A Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 13433870415b42eaaa81dfebcb1831bc Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:38:09.014240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13433870415b42eaaa81dfebcb1831bc"}]}] Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 13433870415b42eaaa81dfebcb1831bc Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesSnapshotsTestJSON-1998306999-project Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: d032189e5a7c41ee8d40f6572b78951a Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1998306999-project Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Snapshot dacf7ae1-bb50-48dd-8039-37f6c7c1e410 could not be found. Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'dacf7ae1-bb50-48dd-8039-37f6c7c1e410'} Jun 29 08:38:09.015729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dacf7ae1-bb50-48dd-8039-37f6c7c1e410 could not be found. (HTTP 404) (Request-ID: req-c94fa0df-a5b5-400b-bd85-c41226f01454) Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:09.016743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:38:09.017940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dacf7ae1-bb50-48dd-8039-37f6c7c1e410 could not be found. Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 29 08:38:09.019273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dacf7ae1-bb50-48dd-8039-37f6c7c1e410 could not be found. Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dacf7ae1-bb50-48dd-8039-37f6c7c1e410 could not be found. Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0d6a3ba5-eb3b-4f32-af46-61d3683d9421 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Returning 404 to user: Snapshot dacf7ae1-bb50-48dd-8039-37f6c7c1e410 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:38:09.021205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0d6a3ba5-eb3b-4f32-af46-61d3683d9421 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410" status: 404 len: 111 microversion: 2.1 time: 0.038096 Jun 29 08:38:09.022158 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 231/443] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:38:08 2022] GET /compute/v2.1/os-snapshots/dacf7ae1-bb50-48dd-8039-37f6c7c1e410 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:38:09.024630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-27655862-87ac-4027-9a34-c5d12d1bf1d9 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade429f550>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:09.093010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-27655862-87ac-4027-9a34-c5d12d1bf1d9 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 202 len: 0 microversion: 2.1 time: 0.071999 Jun 29 08:38:09.093728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 213/444] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:38:09 2022] DELETE /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:38:09.103249 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1df5f60a-be43-47e5-9b39-2528d1f9d759 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4242790>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:09.152707 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1df5f60a-be43-47e5-9b39-2528d1f9d759 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.054055 Jun 29 08:38:09.153281 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 232/445] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:09 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:09.504244 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2949ddbf-5bb2-4645-83f4-cd9ab1f3ab7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:09.504855 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2949ddbf-5bb2-4645-83f4-cd9ab1f3ab7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:09.506731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=56 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:09.512190 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2949ddbf-5bb2-4645-83f4-cd9ab1f3ab7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:09.512637 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2949ddbf-5bb2-4645-83f4-cd9ab1f3ab7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:09.513387 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2949ddbf-5bb2-4645-83f4-cd9ab1f3ab7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:09.513806 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2949ddbf-5bb2-4645-83f4-cd9ab1f3ab7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:09.649605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2949ddbf-5bb2-4645-83f4-cd9ab1f3ab7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:09.658996 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2949ddbf-5bb2-4645-83f4-cd9ab1f3ab7c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.159248 Jun 29 08:38:09.659883 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 214/446] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:09 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:10.166070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f7c8f834-ab3f-4fbb-b588-5fbda75dc0f2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42a0b80>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:10.212530 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f7c8f834-ab3f-4fbb-b588-5fbda75dc0f2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.050321 Jun 29 08:38:10.213136 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 233/447] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:10 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:10.680280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1bc1cbca-0ecc-4835-8fd3-f5b26fbfa9e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:10.681243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1bc1cbca-0ecc-4835-8fd3-f5b26fbfa9e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:10.691007 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1bc1cbca-0ecc-4835-8fd3-f5b26fbfa9e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:10.691444 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1bc1cbca-0ecc-4835-8fd3-f5b26fbfa9e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:10.692186 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1bc1cbca-0ecc-4835-8fd3-f5b26fbfa9e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:10.692608 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1bc1cbca-0ecc-4835-8fd3-f5b26fbfa9e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:10.826233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1bc1cbca-0ecc-4835-8fd3-f5b26fbfa9e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:10.837754 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1bc1cbca-0ecc-4835-8fd3-f5b26fbfa9e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.163724 Jun 29 08:38:10.838517 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 215/448] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:10 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:11.228553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1a0cec93-bba7-4a77-af29-ee51ef133736 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247ee0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:11.275348 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1a0cec93-bba7-4a77-af29-ee51ef133736 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.050865 Jun 29 08:38:11.276111 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 234/449] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:11 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:11.856592 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bdfe55f0-8c11-45f4-826f-d18137a458d3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:11.857155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bdfe55f0-8c11-45f4-826f-d18137a458d3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:11.864120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdfe55f0-8c11-45f4-826f-d18137a458d3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:11.864554 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdfe55f0-8c11-45f4-826f-d18137a458d3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:11.865309 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdfe55f0-8c11-45f4-826f-d18137a458d3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:11.865728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdfe55f0-8c11-45f4-826f-d18137a458d3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:12.008499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bdfe55f0-8c11-45f4-826f-d18137a458d3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:12.018399 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bdfe55f0-8c11-45f4-826f-d18137a458d3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.166475 Jun 29 08:38:12.019017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 216/450] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:11 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:12.289267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-804efaf3-0b39-4ec0-9e43-9d9f1988e686 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4543700>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:12.348441 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-804efaf3-0b39-4ec0-9e43-9d9f1988e686 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.063147 Jun 29 08:38:12.349004 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 235/451] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:12 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:13.037638 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7b20fa7b-c832-451e-9ee6-de5227a29222 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:13.038314 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7b20fa7b-c832-451e-9ee6-de5227a29222 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:13.046886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7b20fa7b-c832-451e-9ee6-de5227a29222 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:13.047432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7b20fa7b-c832-451e-9ee6-de5227a29222 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:13.048369 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7b20fa7b-c832-451e-9ee6-de5227a29222 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:13.048863 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7b20fa7b-c832-451e-9ee6-de5227a29222 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:13.196898 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7b20fa7b-c832-451e-9ee6-de5227a29222 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:13.207206 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7b20fa7b-c832-451e-9ee6-de5227a29222 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.174913 Jun 29 08:38:13.207739 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 217/452] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:13 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:13.364202 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b84428f4-c245-4f64-84b7-5ce775505e57 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4253310>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:13.417940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b84428f4-c245-4f64-84b7-5ce775505e57 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.059795 Jun 29 08:38:13.418568 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 236/453] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:13 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:14.229317 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9704751a-ba88-42e0-b42b-91be83057c7b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:14.230350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9704751a-ba88-42e0-b42b-91be83057c7b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:14.239379 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9704751a-ba88-42e0-b42b-91be83057c7b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:14.239815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9704751a-ba88-42e0-b42b-91be83057c7b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:14.240568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9704751a-ba88-42e0-b42b-91be83057c7b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:14.240990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9704751a-ba88-42e0-b42b-91be83057c7b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:14.387646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9704751a-ba88-42e0-b42b-91be83057c7b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:14.391058 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:14.396138 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9704751a-ba88-42e0-b42b-91be83057c7b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.173453 Jun 29 08:38:14.396707 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 218/454] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:14 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:14.431405 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-de1ef0e2-da14-42d3-8142-84d37dd0ccfd tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade45b71f0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:14.482525 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-de1ef0e2-da14-42d3-8142-84d37dd0ccfd tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.054982 Jun 29 08:38:14.483152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 237/455] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:14 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:15.417417 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0da2ea2f-b6b0-4da4-a91e-def0205a15ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:15.418396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0da2ea2f-b6b0-4da4-a91e-def0205a15ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:15.427761 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0da2ea2f-b6b0-4da4-a91e-def0205a15ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:15.428196 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0da2ea2f-b6b0-4da4-a91e-def0205a15ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:15.428946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0da2ea2f-b6b0-4da4-a91e-def0205a15ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:15.429369 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0da2ea2f-b6b0-4da4-a91e-def0205a15ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:15.494890 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2bcf38b2-b137-4bd7-8732-1e355daded64 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4247160>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:15.548961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2bcf38b2-b137-4bd7-8732-1e355daded64 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.057739 Jun 29 08:38:15.549571 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 238/456] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:15 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:38:15.567884 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0da2ea2f-b6b0-4da4-a91e-def0205a15ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:15.575491 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0da2ea2f-b6b0-4da4-a91e-def0205a15ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.164574 Jun 29 08:38:15.576061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 219/457] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:15 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:16.563919 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dbf7ef18-0d79-441c-875e-052b6d6d8dbd tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42a0e50>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:16.593032 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9090ebdf-6f9c-49cc-aa38-4ba2cc4b6b66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:16.593633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9090ebdf-6f9c-49cc-aa38-4ba2cc4b6b66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:16.600573 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9090ebdf-6f9c-49cc-aa38-4ba2cc4b6b66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:16.601011 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9090ebdf-6f9c-49cc-aa38-4ba2cc4b6b66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:16.601765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9090ebdf-6f9c-49cc-aa38-4ba2cc4b6b66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:16.602186 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9090ebdf-6f9c-49cc-aa38-4ba2cc4b6b66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:16.612732 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dbf7ef18-0d79-441c-875e-052b6d6d8dbd tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.052760 Jun 29 08:38:16.613356 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 239/458] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:16 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:16.827430 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9090ebdf-6f9c-49cc-aa38-4ba2cc4b6b66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:16.837739 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9090ebdf-6f9c-49cc-aa38-4ba2cc4b6b66 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.248824 Jun 29 08:38:16.838322 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 220/459] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:16 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:17.625806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0a010daa-f904-4357-aac4-45ad226b5ca1 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade44400d0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:17.677029 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0a010daa-f904-4357-aac4-45ad226b5ca1 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.055072 Jun 29 08:38:17.677594 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 240/460] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:17 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:17.857647 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-67de5bf2-3e27-42ed-8fcc-7c261c16b2ef tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:17.858263 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-67de5bf2-3e27-42ed-8fcc-7c261c16b2ef tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:17.865880 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-67de5bf2-3e27-42ed-8fcc-7c261c16b2ef tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:17.866321 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-67de5bf2-3e27-42ed-8fcc-7c261c16b2ef tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:17.867109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-67de5bf2-3e27-42ed-8fcc-7c261c16b2ef tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:17.867531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-67de5bf2-3e27-42ed-8fcc-7c261c16b2ef tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:18.000781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-67de5bf2-3e27-42ed-8fcc-7c261c16b2ef tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:18.008766 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-67de5bf2-3e27-42ed-8fcc-7c261c16b2ef tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.156928 Jun 29 08:38:18.009301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 221/461] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:17 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:18.689338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1054c56a-2436-46ac-a72b-977a62d693ad tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42a0dc0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:18.743187 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1054c56a-2436-46ac-a72b-977a62d693ad tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.057847 Jun 29 08:38:18.743744 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 241/462] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:18 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:19.026479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a915fda1-8d44-4951-a8b8-2a68fb6a2fdd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:19.027166 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a915fda1-8d44-4951-a8b8-2a68fb6a2fdd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:19.034336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a915fda1-8d44-4951-a8b8-2a68fb6a2fdd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:19.034825 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a915fda1-8d44-4951-a8b8-2a68fb6a2fdd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:19.035575 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a915fda1-8d44-4951-a8b8-2a68fb6a2fdd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:19.036018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a915fda1-8d44-4951-a8b8-2a68fb6a2fdd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:19.172992 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a915fda1-8d44-4951-a8b8-2a68fb6a2fdd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:19.181338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a915fda1-8d44-4951-a8b8-2a68fb6a2fdd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.158958 Jun 29 08:38:19.186838 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 222/463] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:19 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:19.760739 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-659946f7-199e-4757-a268-871eec542f0b tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade42474c0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:19.816611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-659946f7-199e-4757-a268-871eec542f0b tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.062610 Jun 29 08:38:19.817210 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 242/464] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:19 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:20.198195 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a05fc22e-020d-4c7f-ba26-fa3b3aecabc6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:20.198787 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a05fc22e-020d-4c7f-ba26-fa3b3aecabc6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:20.205503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a05fc22e-020d-4c7f-ba26-fa3b3aecabc6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:20.205946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a05fc22e-020d-4c7f-ba26-fa3b3aecabc6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:20.206721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a05fc22e-020d-4c7f-ba26-fa3b3aecabc6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:20.207130 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a05fc22e-020d-4c7f-ba26-fa3b3aecabc6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:20.350001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a05fc22e-020d-4c7f-ba26-fa3b3aecabc6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:20.361844 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a05fc22e-020d-4c7f-ba26-fa3b3aecabc6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.166899 Jun 29 08:38:20.362584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 223/465] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:20 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:20.833513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ac4b906d-abc6-46a8-b136-79563652ff69 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4253280>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:20.887723 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ac4b906d-abc6-46a8-b136-79563652ff69 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.060797 Jun 29 08:38:20.888287 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 243/466] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:20 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:21.387928 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cee16d6f-db31-4a9e-930d-3217ef829b1d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:21.388913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cee16d6f-db31-4a9e-930d-3217ef829b1d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:21.397197 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cee16d6f-db31-4a9e-930d-3217ef829b1d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:21.397625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cee16d6f-db31-4a9e-930d-3217ef829b1d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:21.398374 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cee16d6f-db31-4a9e-930d-3217ef829b1d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:21.398906 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cee16d6f-db31-4a9e-930d-3217ef829b1d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:21.534818 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cee16d6f-db31-4a9e-930d-3217ef829b1d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:21.542828 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cee16d6f-db31-4a9e-930d-3217ef829b1d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.161264 Jun 29 08:38:21.543410 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 224/467] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:21 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:21.901050 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8f5da227-56a2-4112-9a0a-aea8179cc8e7 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4253f70>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:21.948794 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8f5da227-56a2-4112-9a0a-aea8179cc8e7 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 200 len: 344 microversion: 2.1 time: 0.052672 Jun 29 08:38:21.949596 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 244/468] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:21 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:22.564173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c57e3f24-33d0-4519-bedf-c8ba1bbd34db tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:22.565294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c57e3f24-33d0-4519-bedf-c8ba1bbd34db tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:22.576355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c57e3f24-33d0-4519-bedf-c8ba1bbd34db tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:22.577085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c57e3f24-33d0-4519-bedf-c8ba1bbd34db tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:22.578330 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c57e3f24-33d0-4519-bedf-c8ba1bbd34db tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:22.579086 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c57e3f24-33d0-4519-bedf-c8ba1bbd34db tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:22.742615 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c57e3f24-33d0-4519-bedf-c8ba1bbd34db tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:22.750140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c57e3f24-33d0-4519-bedf-c8ba1bbd34db tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.192579 Jun 29 08:38:22.750711 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 225/469] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:22 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:22.965995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-38686683-de19-43bb-a0a5-51707f50abdc tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4253040>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:22.995796 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-38686683-de19-43bb-a0a5-51707f50abdc tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] HTTP exception thrown: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-38686683-de19-43bb-a0a5-51707f50abdc tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Request method failure captured: Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 HTTP/1.1 Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA9eUpxvWe9TwUwmCTXrcae-V0abRRHj-cLc9dpjIyeVLYzQoqNn7xLQgJW8uHp-iIAitF8kTxv9SeDhUE1oLDIww7re6E3o5M51VsvC7v2187R2_Q6vRLQR4GZXdZSZnye04eFa19hSBBRWSvyo9PF4HOKRWJyavRg0uYdt8VSTA_A Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 13433870415b42eaaa81dfebcb1831bc Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:38:22.998041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13433870415b42eaaa81dfebcb1831bc"}]}] Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 13433870415b42eaaa81dfebcb1831bc Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesSnapshotsTestJSON-1998306999-project Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: d032189e5a7c41ee8d40f6572b78951a Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1998306999-project Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '8681a617-5c06-4987-a7af-a2e0ca378882'} Jun 29 08:38:22.999516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. (HTTP 404) (Request-ID: req-86eb3acc-a4ff-47b2-9a16-dccbe3319598) Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.000548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:38:23.001907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 08:38:23.003346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-38686683-de19-43bb-a0a5-51707f50abdc tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Returning 404 to user: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-38686683-de19-43bb-a0a5-51707f50abdc tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 404 len: 109 microversion: 2.1 time: 0.040426 Jun 29 08:38:23.005078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 245/470] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:22 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:38:23.010119 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3c2565a1-7cf9-43b2-a7e5-3db5b66b2c4f tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4252280>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:23.039219 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-3c2565a1-7cf9-43b2-a7e5-3db5b66b2c4f tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] HTTP exception thrown: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3c2565a1-7cf9-43b2-a7e5-3db5b66b2c4f tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Request method failure captured: Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 HTTP/1.1 Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA9eUpxvWe9TwUwmCTXrcae-V0abRRHj-cLc9dpjIyeVLYzQoqNn7xLQgJW8uHp-iIAitF8kTxv9SeDhUE1oLDIww7re6E3o5M51VsvC7v2187R2_Q6vRLQR4GZXdZSZnye04eFa19hSBBRWSvyo9PF4HOKRWJyavRg0uYdt8VSTA_A Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 13433870415b42eaaa81dfebcb1831bc Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:38:23.041189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13433870415b42eaaa81dfebcb1831bc"}]}] Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 13433870415b42eaaa81dfebcb1831bc Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-VolumesSnapshotsTestJSON-1998306999-project Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: d032189e5a7c41ee8d40f6572b78951a Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1998306999-project Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '8681a617-5c06-4987-a7af-a2e0ca378882'} Jun 29 08:38:23.042607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. (HTTP 404) (Request-ID: req-94faa3cd-46a6-415d-9d4b-55dfc0f85b30) Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.043676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:38:23.045238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 08:38:23.046550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3c2565a1-7cf9-43b2-a7e5-3db5b66b2c4f tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Returning 404 to user: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3c2565a1-7cf9-43b2-a7e5-3db5b66b2c4f tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 404 len: 109 microversion: 2.1 time: 0.036365 Jun 29 08:38:23.048165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 226/471] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:38:23 2022] DELETE /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:38:23.055299 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3564a726-beb6-4557-b390-a4205bbb44f2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Calling method '.version_select at 0x7fade4543700>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:23.084655 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-3564a726-beb6-4557-b390-a4205bbb44f2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] HTTP exception thrown: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3564a726-beb6-4557-b390-a4205bbb44f2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Request method failure captured: Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 HTTP/1.1 Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA9eUpxvWe9TwUwmCTXrcae-V0abRRHj-cLc9dpjIyeVLYzQoqNn7xLQgJW8uHp-iIAitF8kTxv9SeDhUE1oLDIww7re6E3o5M51VsvC7v2187R2_Q6vRLQR4GZXdZSZnye04eFa19hSBBRWSvyo9PF4HOKRWJyavRg0uYdt8VSTA_A Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 13433870415b42eaaa81dfebcb1831bc Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:38:23.086589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13433870415b42eaaa81dfebcb1831bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13433870415b42eaaa81dfebcb1831bc"}]}] Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 13433870415b42eaaa81dfebcb1831bc Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1998306999 Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesSnapshotsTestJSON-1998306999-project Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: d032189e5a7c41ee8d40f6572b78951a Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1998306999-project Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '8681a617-5c06-4987-a7af-a2e0ca378882'} Jun 29 08:38:23.088006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. (HTTP 404) (Request-ID: req-0dd3d2a0-7eb9-45fe-8575-881b69442be6) Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.088849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:38:23.090564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 08:38:23.091852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3564a726-beb6-4557-b390-a4205bbb44f2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] Returning 404 to user: Volume 8681a617-5c06-4987-a7af-a2e0ca378882 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3564a726-beb6-4557-b390-a4205bbb44f2 tempest-VolumesSnapshotsTestJSON-1998306999 tempest-VolumesSnapshotsTestJSON-1998306999-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882" status: 404 len: 109 microversion: 2.1 time: 0.038035 Jun 29 08:38:23.093543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 246/472] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:23 2022] GET /compute/v2.1/os-volumes/8681a617-5c06-4987-a7af-a2e0ca378882 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:38:23.768632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c76ac894-273a-4e5a-b1e7-5acdce787fda tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:23.769310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c76ac894-273a-4e5a-b1e7-5acdce787fda tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:23.783104 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c76ac894-273a-4e5a-b1e7-5acdce787fda tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:23.783544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c76ac894-273a-4e5a-b1e7-5acdce787fda tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:23.784343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c76ac894-273a-4e5a-b1e7-5acdce787fda tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:23.784763 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c76ac894-273a-4e5a-b1e7-5acdce787fda tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:23.917292 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c76ac894-273a-4e5a-b1e7-5acdce787fda tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:23.925218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c76ac894-273a-4e5a-b1e7-5acdce787fda tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.161594 Jun 29 08:38:23.925812 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 227/473] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:23 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:24.942375 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0819d361-d5b6-4b2a-a0b6-2437582bb5b3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:24.942988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0819d361-d5b6-4b2a-a0b6-2437582bb5b3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:24.949281 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0819d361-d5b6-4b2a-a0b6-2437582bb5b3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:24.949712 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0819d361-d5b6-4b2a-a0b6-2437582bb5b3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:24.950476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0819d361-d5b6-4b2a-a0b6-2437582bb5b3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:24.950945 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0819d361-d5b6-4b2a-a0b6-2437582bb5b3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:25.085575 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0819d361-d5b6-4b2a-a0b6-2437582bb5b3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:25.095420 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0819d361-d5b6-4b2a-a0b6-2437582bb5b3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1502 microversion: 2.1 time: 0.157044 Jun 29 08:38:25.095987 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 247/474] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:24 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:25.112952 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "665bd676-6b57-4b69-980b-113acb77be55"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:38:25.114012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:25.120827 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:25.121261 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:25.122013 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:25.122467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:25.148240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] HTTP exception thrown: Cannot 'attach_volume' instance b8f1f6d1-d03f-4304-b607-4ea8870be425 while it is in vm_state rescued Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Request method failure captured: Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: POST /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425/os-volume_attachments HTTP/1.1 Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 74 Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7FQdokTaeGJQNjt-Zh-T_72ZIosTruGY34RQQGF3CuMCucL-NzwfI1LMeJQdYqJxdI52SbBBLbUF2WBxubSMX8i43QQfqMVuS-_FPiG8NVTwoSioRUYIeZfSiMUSeT6sA91CET2FnsLyd4oP--fhYZhW2EdAaSpSsURItcg-4mMkk Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:38:25.150477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96872c14d1224c92b3247285f03bb966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96872c14d1224c92b3247285f03bb966"}]}] Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: ac984d1f6efa403e85483bd7fa78000e Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {"volumeAttachment": {"volumeId": "665bd676-6b57-4b69-980b-113acb77be55"}} Jun 29 08:38:25.151741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Cannot 'attach_volume' instance b8f1f6d1-d03f-4304-b607-4ea8870be425 while it is in vm_state rescued Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'server_id': 'b8f1f6d1-d03f-4304-b607-4ea8870be425', 'body': {'volumeAttachment': {'volumeId': '665bd676-6b57-4b69-980b-113acb77be55'}}} Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8f1f6d1-d03f-4304-b607-4ea8870be425 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:38:25.152463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b8f1f6d1-d03f-4304-b607-4ea8870be425 while it is in vm_state rescued Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:38:25.153660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:38:25.155212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:38:25.155212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:38:25.155212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b8f1f6d1-d03f-4304-b607-4ea8870be425 while it is in vm_state rescued Jun 29 08:38:25.155212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:38:25.155212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Returning 409 to user: Cannot 'attach_volume' instance b8f1f6d1-d03f-4304-b607-4ea8870be425 while it is in vm_state rescued {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:38:25.155212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f15fa984-653d-4e16-9f98-a636b148701d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043331 Jun 29 08:38:25.155212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 228/475] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:38:25 2022] POST /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 08:38:25.161608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d12cf917-3528-4308-b728-8898cb602c17 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:38:25.162176 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d12cf917-3528-4308-b728-8898cb602c17 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:25.168485 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d12cf917-3528-4308-b728-8898cb602c17 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:25.168935 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d12cf917-3528-4308-b728-8898cb602c17 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:25.169689 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d12cf917-3528-4308-b728-8898cb602c17 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:25.170108 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d12cf917-3528-4308-b728-8898cb602c17 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:25.247349 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d12cf917-3528-4308-b728-8898cb602c17 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425/action" status: 202 len: 0 microversion: 2.1 time: 0.089251 Jun 29 08:38:25.248463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 248/476] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:38:25 2022] POST /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:38:25.256488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-58ec223d-3fc6-41e6-8741-56f35c9d6b18 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:25.257088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-58ec223d-3fc6-41e6-8741-56f35c9d6b18 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:25.263244 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-58ec223d-3fc6-41e6-8741-56f35c9d6b18 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:25.263650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-58ec223d-3fc6-41e6-8741-56f35c9d6b18 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:25.264428 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-58ec223d-3fc6-41e6-8741-56f35c9d6b18 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:25.264821 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-58ec223d-3fc6-41e6-8741-56f35c9d6b18 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:25.478474 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-58ec223d-3fc6-41e6-8741-56f35c9d6b18 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:25.487382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-58ec223d-3fc6-41e6-8741-56f35c9d6b18 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1510 microversion: 2.1 time: 0.234433 Jun 29 08:38:25.487878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 229/477] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:25 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:26.505998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fc90e852-8f8f-45ef-aacd-cd62ec6d6c95 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:26.506716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fc90e852-8f8f-45ef-aacd-cd62ec6d6c95 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:26.513501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc90e852-8f8f-45ef-aacd-cd62ec6d6c95 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:26.513943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc90e852-8f8f-45ef-aacd-cd62ec6d6c95 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:26.514739 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc90e852-8f8f-45ef-aacd-cd62ec6d6c95 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:26.515143 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc90e852-8f8f-45ef-aacd-cd62ec6d6c95 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:26.885548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fc90e852-8f8f-45ef-aacd-cd62ec6d6c95 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:26.899699 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fc90e852-8f8f-45ef-aacd-cd62ec6d6c95 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1510 microversion: 2.1 time: 0.397492 Jun 29 08:38:26.900630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 249/478] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:26 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:27.920948 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9faf48a9-f5a8-44be-a575-b9337cbabe37 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:27.921940 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9faf48a9-f5a8-44be-a575-b9337cbabe37 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:27.929935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9faf48a9-f5a8-44be-a575-b9337cbabe37 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:27.930371 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9faf48a9-f5a8-44be-a575-b9337cbabe37 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:27.931141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9faf48a9-f5a8-44be-a575-b9337cbabe37 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:27.931558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9faf48a9-f5a8-44be-a575-b9337cbabe37 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:28.034559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6d38c6fc-056d-453a-be6b-2702f810f0b6 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade42429d0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:28.068065 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9faf48a9-f5a8-44be-a575-b9337cbabe37 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:28.075449 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9faf48a9-f5a8-44be-a575-b9337cbabe37 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1510 microversion: 2.1 time: 0.161146 Jun 29 08:38:28.075989 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 230/479] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:27 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:28.084251 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6d38c6fc-056d-453a-be6b-2702f810f0b6 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/923546ac-1d3b-425d-a266-4a1d01395065" status: 200 len: 351 microversion: 2.1 time: 0.053105 Jun 29 08:38:28.084844 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 250/480] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:28 2022] GET /compute/v2.1/os-volumes/923546ac-1d3b-425d-a266-4a1d01395065 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:38:29.095012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-536ff1c3-cd67-4e4e-b104-57be8a77d00d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:29.095657 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-536ff1c3-cd67-4e4e-b104-57be8a77d00d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:29.103780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-536ff1c3-cd67-4e4e-b104-57be8a77d00d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:29.104253 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-536ff1c3-cd67-4e4e-b104-57be8a77d00d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:29.105003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-536ff1c3-cd67-4e4e-b104-57be8a77d00d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:29.105428 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-536ff1c3-cd67-4e4e-b104-57be8a77d00d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:29.244775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-536ff1c3-cd67-4e4e-b104-57be8a77d00d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:29.252479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-536ff1c3-cd67-4e4e-b104-57be8a77d00d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1510 microversion: 2.1 time: 0.163092 Jun 29 08:38:29.253219 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 231/481] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:29 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:30.270467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-981686b4-26dc-4970-aa32-51877cbf9ca4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:30.271104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-981686b4-26dc-4970-aa32-51877cbf9ca4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:30.278837 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-981686b4-26dc-4970-aa32-51877cbf9ca4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:30.279429 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-981686b4-26dc-4970-aa32-51877cbf9ca4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:30.280653 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-981686b4-26dc-4970-aa32-51877cbf9ca4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:30.281140 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-981686b4-26dc-4970-aa32-51877cbf9ca4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:30.418531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-981686b4-26dc-4970-aa32-51877cbf9ca4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:30.430152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-981686b4-26dc-4970-aa32-51877cbf9ca4 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1516 microversion: 2.1 time: 0.163777 Jun 29 08:38:30.430892 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 251/482] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:30 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:30.503992 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-119a0e07-ef8d-46f2-b8af-8f81204fb3b5 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4252160>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:30.549651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-119a0e07-ef8d-46f2-b8af-8f81204fb3b5 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/7061d558-3bd9-4afd-a98e-08f23733c3bd" status: 200 len: 350 microversion: 2.1 time: 0.049542 Jun 29 08:38:30.550199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 232/483] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:30 2022] GET /compute/v2.1/os-volumes/7061d558-3bd9-4afd-a98e-08f23733c3bd => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:36.677671 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:38:36.678480 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Wed Jun 29 08:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:38:38.146419 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-17adba03-450e-4903-a2f4-30546584773a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'create', calling method: .version_select at 0x7fade42a0dc0>, body: {"keypair": {"name": "tempest-keypair-1372011357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK69Rptoqby/EjHblAOMLxlzldGGw+Yb/Ecv1lhPKhAokERMwIERXV4MhrtxpFG1Sp0GiepgVIanZTFACccQ1jmek7iIlo92Nq465kc8UeI60vefE3gSqs1C/7rKM4vLow=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:38:38.162201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-17adba03-450e-4903-a2f4-30546584773a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Getting quotas for project 96872c14d1224c92b3247285f03bb966. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:38:38.166633 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-17adba03-450e-4903-a2f4-30546584773a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Getting quotas for user ac984d1f6efa403e85483bd7fa78000e and project 96872c14d1224c92b3247285f03bb966. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:38:38.196267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-17adba03-450e-4903-a2f4-30546584773a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054088 Jun 29 08:38:38.196891 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 252/484] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:38:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:39.270266 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=33 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:39.271094 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=70 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:39.274976 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-70b1be30-c226-45f4-977e-7b56f70032ff tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4256dc0>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:39.323788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-70b1be30-c226-45f4-977e-7b56f70032ff tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/afa49532-7216-4539-9b42-8fafb739a835" status: 200 len: 351 microversion: 2.1 time: 0.054881 Jun 29 08:38:39.324357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 233/485] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:38:39 2022] GET /compute/v2.1/os-volumes/afa49532-7216-4539-9b42-8fafb739a835 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:39.335776 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-09259c8c-2dc6-4433-8b2d-f4e06191b1fa tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4247d30>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:39.419376 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-09259c8c-2dc6-4433-8b2d-f4e06191b1fa tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087390 Jun 29 08:38:39.426977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 253/486] 10.222.0.27 () {58 vars in 1133 bytes} [Wed Jun 29 08:38:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:39.433145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f19b1aff-fa04-42d0-a68e-0df80b9b53ee tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4261550>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:39.520808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f19b1aff-fa04-42d0-a68e-0df80b9b53ee tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091095 Jun 29 08:38:39.521532 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 234/487] 10.222.0.27 () {58 vars in 1148 bytes} [Wed Jun 29 08:38:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:39.534213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-82110102-0ba7-4df9-81be-4dd9f65e6636 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4253280>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:39.546935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-867075824", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7723dae1-92ba-46d4-a07d-34a93508cbcb"}], "security_groups": [{"name": "tempest-securitygroup--621714091"}], "key_name": "tempest-keypair-1372011357", "user_data": "}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:38:39.618167 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-82110102-0ba7-4df9-81be-4dd9f65e6636 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088192 Jun 29 08:38:39.618756 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 254/488] 10.222.0.27 () {58 vars in 1133 bytes} [Wed Jun 29 08:38:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:38:39.629572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8d82e3cf-61bb-4cba-98d0-28d6d217e47f tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4543700>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:39.660018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] validate_networks() for [('7723dae1-92ba-46d4-a07d-34a93508cbcb', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:38:39.712412 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8d82e3cf-61bb-4cba-98d0-28d6d217e47f tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086528 Jun 29 08:38:39.713051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 255/489] 10.222.0.27 () {58 vars in 1166 bytes} [Wed Jun 29 08:38:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:38:39.724849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ca22537f-3c90-4560-b34b-1d81f212c241 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4223550>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:39.803712 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ca22537f-3c90-4560-b34b-1d81f212c241 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082519 Jun 29 08:38:39.804283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 256/490] 10.222.0.27 () {58 vars in 1169 bytes} [Wed Jun 29 08:38:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:38:39.816385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-362c6522-2d4b-46f7-abc3-ec0b3c2faaf8 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4242af0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:39.898955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-362c6522-2d4b-46f7-abc3-ec0b3c2faaf8 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086214 Jun 29 08:38:39.899724 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 257/491] 10.222.0.27 () {58 vars in 1154 bytes} [Wed Jun 29 08:38:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:38:39.910533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cc588619-e531-405c-9c24-4b6e400cb9c4 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4253310>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:40.051258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:38:40.051680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:38:40.052187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:38:40.052625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:38:40.053090 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:38:40.063486 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:40.063927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:40.064714 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:40.065142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:40.083387 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Getting quotas for project 96872c14d1224c92b3247285f03bb966. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:38:40.087981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Getting quotas for user ac984d1f6efa403e85483bd7fa78000e and project 96872c14d1224c92b3247285f03bb966. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:38:40.101154 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:38:40.103460 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:38:40.153801 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR oslo.messaging._drivers.impl_rabbit [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [1fed9213-6614-46b6-9fd5-fa36918a94b4] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 08:38:40.157007 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cc588619-e531-405c-9c24-4b6e400cb9c4 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.249826 Jun 29 08:38:40.157582 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 258/492] 10.222.0.27 () {58 vars in 1187 bytes} [Wed Jun 29 08:38:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:38:40.173145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-26c0a9d3-5320-47ae-9eea-483c37920622 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] Calling method '.version_select at 0x7fade4223f70>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:40.424751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:40.428169 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-26c0a9d3-5320-47ae-9eea-483c37920622 tempest-VolumesTestJSON-123501733 tempest-VolumesTestJSON-123501733-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.259075 Jun 29 08:38:40.428743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 259/493] 10.222.0.27 () {58 vars in 1154 bytes} [Wed Jun 29 08:38:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:41.163703 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [1fed9213-6614-46b6-9fd5-fa36918a94b4] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55262. Jun 29 08:38:41.169209 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-333c59b0-266f-45ae-a0fc-640608964e8e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.626347 Jun 29 08:38:41.169858 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 235/494] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:38:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:38:41.180084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8dfdd368-9215-4191-bd62-fdf69d5c80c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:41.180686 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8dfdd368-9215-4191-bd62-fdf69d5c80c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:41.241342 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8dfdd368-9215-4191-bd62-fdf69d5c80c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:41.248496 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8dfdd368-9215-4191-bd62-fdf69d5c80c9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1245 microversion: 2.1 time: 0.072573 Jun 29 08:38:41.249128 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 260/495] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:41 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:42.077626 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:38:42.077801 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 08:38:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:38:42.271653 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-21a75c38-0dd1-4463-b8fe-c84e02e7ed9d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:42.272322 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-21a75c38-0dd1-4463-b8fe-c84e02e7ed9d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:42.327053 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-21a75c38-0dd1-4463-b8fe-c84e02e7ed9d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:42.334012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-21a75c38-0dd1-4463-b8fe-c84e02e7ed9d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1245 microversion: 2.1 time: 0.069875 Jun 29 08:38:42.334432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 236/496] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:42 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:43.353079 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6330f05c-00f0-4d52-805b-e3df3b63e071 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:43.353806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6330f05c-00f0-4d52-805b-e3df3b63e071 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:43.361438 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6330f05c-00f0-4d52-805b-e3df3b63e071 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:43.361957 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6330f05c-00f0-4d52-805b-e3df3b63e071 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:43.362869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6330f05c-00f0-4d52-805b-e3df3b63e071 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:43.363364 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6330f05c-00f0-4d52-805b-e3df3b63e071 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:43.431702 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6330f05c-00f0-4d52-805b-e3df3b63e071 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:43.443382 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6330f05c-00f0-4d52-805b-e3df3b63e071 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1249 microversion: 2.1 time: 0.095115 Jun 29 08:38:43.444248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 261/497] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:43 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:44.466474 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d9187772-7943-4c3a-aade-d2c2141df5c0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:44.467077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d9187772-7943-4c3a-aade-d2c2141df5c0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:44.477928 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d9187772-7943-4c3a-aade-d2c2141df5c0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:44.478569 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d9187772-7943-4c3a-aade-d2c2141df5c0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:44.479840 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d9187772-7943-4c3a-aade-d2c2141df5c0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:44.480450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d9187772-7943-4c3a-aade-d2c2141df5c0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:44.555667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d9187772-7943-4c3a-aade-d2c2141df5c0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:44.563248 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d9187772-7943-4c3a-aade-d2c2141df5c0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1297 microversion: 2.1 time: 0.101522 Jun 29 08:38:44.563826 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 237/498] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:44 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:45.581281 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-37b8ea20-4451-484d-acbb-5e89e9cfefd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:45.581959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-37b8ea20-4451-484d-acbb-5e89e9cfefd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:45.588428 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-37b8ea20-4451-484d-acbb-5e89e9cfefd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:45.588879 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-37b8ea20-4451-484d-acbb-5e89e9cfefd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:45.589648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-37b8ea20-4451-484d-acbb-5e89e9cfefd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:45.590469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-37b8ea20-4451-484d-acbb-5e89e9cfefd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:45.816075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-37b8ea20-4451-484d-acbb-5e89e9cfefd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:45.825729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-37b8ea20-4451-484d-acbb-5e89e9cfefd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.248192 Jun 29 08:38:45.827013 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 262/499] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:45 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:46.323026 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-84a1207b-9d59-4483-8871-84f55148de3d req-20f11b02-038e-4562-86dc-af2d1a711302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b2d8b0-44c2-4e85-9d24-0c27d7164edf", "tag": "0bca97cc-eb16-48a9-938f-a393ebc2d7f4"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:38:46.332170 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-84a1207b-9d59-4483-8871-84f55148de3d req-20f11b02-038e-4562-86dc-af2d1a711302 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:46.332707 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-84a1207b-9d59-4483-8871-84f55148de3d req-20f11b02-038e-4562-86dc-af2d1a711302 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:46.345892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-84a1207b-9d59-4483-8871-84f55148de3d req-20f11b02-038e-4562-86dc-af2d1a711302 service nova] Creating event network-changed:0bca97cc-eb16-48a9-938f-a393ebc2d7f4 for instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf on hv-cinder-79760 Jun 29 08:38:46.351294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-84a1207b-9d59-4483-8871-84f55148de3d req-20f11b02-038e-4562-86dc-af2d1a711302 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Jun 29 08:38:46.351856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 238/500] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:46.844142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4baa1387-a42c-418a-a711-1b8f08c4725a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:46.844736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4baa1387-a42c-418a-a711-1b8f08c4725a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:46.851233 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4baa1387-a42c-418a-a711-1b8f08c4725a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:46.851673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4baa1387-a42c-418a-a711-1b8f08c4725a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:46.852412 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4baa1387-a42c-418a-a711-1b8f08c4725a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:46.852917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4baa1387-a42c-418a-a711-1b8f08c4725a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:47.079535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4baa1387-a42c-418a-a711-1b8f08c4725a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:47.087924 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4baa1387-a42c-418a-a711-1b8f08c4725a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.247957 Jun 29 08:38:47.088500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 263/501] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:46 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:48.107441 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5a30911d-5723-45a1-8ddd-da576a57f9bd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:48.120632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5a30911d-5723-45a1-8ddd-da576a57f9bd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:48.126024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5a30911d-5723-45a1-8ddd-da576a57f9bd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:48.126467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5a30911d-5723-45a1-8ddd-da576a57f9bd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:48.127257 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5a30911d-5723-45a1-8ddd-da576a57f9bd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:48.127682 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5a30911d-5723-45a1-8ddd-da576a57f9bd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:48.271960 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5a30911d-5723-45a1-8ddd-da576a57f9bd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:48.279852 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5a30911d-5723-45a1-8ddd-da576a57f9bd tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.177196 Jun 29 08:38:48.280394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 239/502] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:48 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:49.297892 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-049d6f1b-4338-4a46-a4e2-58f4b7b3897d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:49.298499 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-049d6f1b-4338-4a46-a4e2-58f4b7b3897d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:49.321147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-049d6f1b-4338-4a46-a4e2-58f4b7b3897d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:49.321684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-049d6f1b-4338-4a46-a4e2-58f4b7b3897d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:49.322454 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-049d6f1b-4338-4a46-a4e2-58f4b7b3897d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:49.324387 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-049d6f1b-4338-4a46-a4e2-58f4b7b3897d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:49.470064 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-049d6f1b-4338-4a46-a4e2-58f4b7b3897d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:49.477552 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-049d6f1b-4338-4a46-a4e2-58f4b7b3897d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.183506 Jun 29 08:38:49.478380 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 264/503] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:49 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:50.495827 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9fd47e70-de69-4d29-b4f2-30182971a713 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:50.496523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9fd47e70-de69-4d29-b4f2-30182971a713 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:50.501146 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:50.509389 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9fd47e70-de69-4d29-b4f2-30182971a713 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:50.512423 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9fd47e70-de69-4d29-b4f2-30182971a713 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:50.513504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9fd47e70-de69-4d29-b4f2-30182971a713 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:50.513941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9fd47e70-de69-4d29-b4f2-30182971a713 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:50.669763 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9fd47e70-de69-4d29-b4f2-30182971a713 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:50.677223 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9fd47e70-de69-4d29-b4f2-30182971a713 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.186465 Jun 29 08:38:50.677787 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 240/504] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:50 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:51.695636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e6c846bc-e86a-442c-9d47-9244bda49664 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:51.696266 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e6c846bc-e86a-442c-9d47-9244bda49664 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:51.701438 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:51.703029 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:51.705260 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6c846bc-e86a-442c-9d47-9244bda49664 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:51.705896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6c846bc-e86a-442c-9d47-9244bda49664 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:51.706623 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6c846bc-e86a-442c-9d47-9244bda49664 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:51.707117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6c846bc-e86a-442c-9d47-9244bda49664 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:51.899793 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e6c846bc-e86a-442c-9d47-9244bda49664 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:51.908249 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e6c846bc-e86a-442c-9d47-9244bda49664 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.217836 Jun 29 08:38:51.909119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 265/505] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:51 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:52.926058 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0c297795-2688-4db1-a9da-e967bd75f63e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:52.927593 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0c297795-2688-4db1-a9da-e967bd75f63e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:52.931386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=8 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:38:52.934971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c297795-2688-4db1-a9da-e967bd75f63e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:52.935415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c297795-2688-4db1-a9da-e967bd75f63e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:52.936172 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c297795-2688-4db1-a9da-e967bd75f63e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:52.936779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c297795-2688-4db1-a9da-e967bd75f63e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:53.080074 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0c297795-2688-4db1-a9da-e967bd75f63e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:53.087681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0c297795-2688-4db1-a9da-e967bd75f63e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.166035 Jun 29 08:38:53.088773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 241/506] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:52 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:53.473913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-4821ae50-e687-4fd4-9a9a-b7c078af45d6 req-7f299870-c219-4467-a763-d0815ee3b864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2d8b0-44c2-4e85-9d24-0c27d7164edf", "name": "network-vif-plugged", "status": "completed", "tag": "0bca97cc-eb16-48a9-938f-a393ebc2d7f4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:38:53.492931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-4821ae50-e687-4fd4-9a9a-b7c078af45d6 req-7f299870-c219-4467-a763-d0815ee3b864 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:53.492931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-4821ae50-e687-4fd4-9a9a-b7c078af45d6 req-7f299870-c219-4467-a763-d0815ee3b864 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:53.498004 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-4821ae50-e687-4fd4-9a9a-b7c078af45d6 req-7f299870-c219-4467-a763-d0815ee3b864 service nova] Creating event network-vif-plugged:0bca97cc-eb16-48a9-938f-a393ebc2d7f4 for instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf on hv-cinder-79760 Jun 29 08:38:53.504790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-4821ae50-e687-4fd4-9a9a-b7c078af45d6 req-7f299870-c219-4467-a763-d0815ee3b864 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032881 Jun 29 08:38:53.505341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 266/507] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:38:54.106633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c17c4db4-afb0-4d65-86ce-0f1e6a5e92e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:54.107328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c17c4db4-afb0-4d65-86ce-0f1e6a5e92e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:54.113846 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c17c4db4-afb0-4d65-86ce-0f1e6a5e92e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:54.114290 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c17c4db4-afb0-4d65-86ce-0f1e6a5e92e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:54.115226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c17c4db4-afb0-4d65-86ce-0f1e6a5e92e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:54.115775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c17c4db4-afb0-4d65-86ce-0f1e6a5e92e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:54.248484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c17c4db4-afb0-4d65-86ce-0f1e6a5e92e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:54.256056 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c17c4db4-afb0-4d65-86ce-0f1e6a5e92e9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.153316 Jun 29 08:38:54.256611 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 242/508] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:54 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:55.274103 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0beacb49-bc73-443a-98b2-13b115908f88 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:55.274103 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0beacb49-bc73-443a-98b2-13b115908f88 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:55.280425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0beacb49-bc73-443a-98b2-13b115908f88 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:55.280951 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0beacb49-bc73-443a-98b2-13b115908f88 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:55.281761 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0beacb49-bc73-443a-98b2-13b115908f88 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:55.282155 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0beacb49-bc73-443a-98b2-13b115908f88 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:55.433527 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0beacb49-bc73-443a-98b2-13b115908f88 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:55.441324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0beacb49-bc73-443a-98b2-13b115908f88 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1370 microversion: 2.1 time: 0.172132 Jun 29 08:38:55.451211 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 267/509] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:55 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:56.467771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4338925d-3c20-44ec-ab26-7d5ce49285fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:56.468373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4338925d-3c20-44ec-ab26-7d5ce49285fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:56.475264 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4338925d-3c20-44ec-ab26-7d5ce49285fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:56.475875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4338925d-3c20-44ec-ab26-7d5ce49285fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:56.477244 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4338925d-3c20-44ec-ab26-7d5ce49285fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:56.477812 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4338925d-3c20-44ec-ab26-7d5ce49285fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:56.626383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4338925d-3c20-44ec-ab26-7d5ce49285fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:38:56.636025 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4338925d-3c20-44ec-ab26-7d5ce49285fc tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1563 microversion: 2.1 time: 0.180562 Jun 29 08:38:56.647980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 243/510] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:38:56 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:38:56.654400 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-57714e13-ff1a-429f-8c65-b34fa6959747 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:38:56.654891 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-57714e13-ff1a-429f-8c65-b34fa6959747 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:38:56.661433 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57714e13-ff1a-429f-8c65-b34fa6959747 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:56.661851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57714e13-ff1a-429f-8c65-b34fa6959747 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:56.662778 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57714e13-ff1a-429f-8c65-b34fa6959747 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:56.663284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57714e13-ff1a-429f-8c65-b34fa6959747 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:56.746066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-57714e13-ff1a-429f-8c65-b34fa6959747 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095592 Jun 29 08:38:56.746866 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 268/511] 10.222.0.27 () {58 vars in 1274 bytes} [Wed Jun 29 08:38:56 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:38:58.307021 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-dcb58479-3913-4c0d-aa0f-466525009e9e req-0c8a5a71-e8be-426a-ad12-e47959e10bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b2d8b0-44c2-4e85-9d24-0c27d7164edf", "tag": "0bca97cc-eb16-48a9-938f-a393ebc2d7f4"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:38:58.315887 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-dcb58479-3913-4c0d-aa0f-466525009e9e req-0c8a5a71-e8be-426a-ad12-e47959e10bdc service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:38:58.316653 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-dcb58479-3913-4c0d-aa0f-466525009e9e req-0c8a5a71-e8be-426a-ad12-e47959e10bdc service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:38:58.330638 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-dcb58479-3913-4c0d-aa0f-466525009e9e req-0c8a5a71-e8be-426a-ad12-e47959e10bdc service nova] Creating event network-changed:0bca97cc-eb16-48a9-938f-a393ebc2d7f4 for instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf on hv-cinder-79760 Jun 29 08:38:58.336103 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-dcb58479-3913-4c0d-aa0f-466525009e9e req-0c8a5a71-e8be-426a-ad12-e47959e10bdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032918 Jun 29 08:38:58.337125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 244/512] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:39:02.284476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1889133302", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "networks": [{"uuid": "8b77b65e-aef4-46b9-8d10-e3ad890c8f41"}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:39:02.335532 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] validate_networks() for [('8b77b65e-aef4-46b9-8d10-e3ad890c8f41', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:39:02.702718 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:39:02.703353 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:39:02.704158 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:39:02.704802 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:39:02.705442 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:39:02.721081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:02.721680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:02.722963 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:02.723613 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:02.742943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Getting quotas for project d1cc844419c14acd9a9e7dfb4233841d. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:39:02.747542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Getting quotas for user e3be3323efb945f1ad6537bbc9eba7b0 and project d1cc844419c14acd9a9e7dfb4233841d. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:39:02.759204 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:39:02.761514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:39:02.820326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-30be4622-a158-4d9e-92f8-dfd13449442d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540069 Jun 29 08:39:02.821043 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 269/513] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:39:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:39:02.832906 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-58d76267-d8b7-4360-9638-b82eba91a330 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:02.833924 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-58d76267-d8b7-4360-9638-b82eba91a330 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:02.889343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-58d76267-d8b7-4360-9638-b82eba91a330 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:02.896074 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-58d76267-d8b7-4360-9638-b82eba91a330 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1219 microversion: 2.1 time: 0.068070 Jun 29 08:39:02.896659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 245/514] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:02 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:03.914839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-11c9bbb6-0cda-4113-987c-2e0742ca5c3e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:03.915557 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-11c9bbb6-0cda-4113-987c-2e0742ca5c3e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:03.922973 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11c9bbb6-0cda-4113-987c-2e0742ca5c3e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:03.923463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11c9bbb6-0cda-4113-987c-2e0742ca5c3e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:03.924295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11c9bbb6-0cda-4113-987c-2e0742ca5c3e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:03.924794 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11c9bbb6-0cda-4113-987c-2e0742ca5c3e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:03.996594 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-11c9bbb6-0cda-4113-987c-2e0742ca5c3e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:04.005769 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-11c9bbb6-0cda-4113-987c-2e0742ca5c3e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1223 microversion: 2.1 time: 0.094989 Jun 29 08:39:04.006488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 270/515] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:03 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:05.026713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ffd69120-45fc-4ebf-9416-f2da9352ccb1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:05.027433 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ffd69120-45fc-4ebf-9416-f2da9352ccb1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:05.039505 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ffd69120-45fc-4ebf-9416-f2da9352ccb1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:05.040357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ffd69120-45fc-4ebf-9416-f2da9352ccb1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:05.041297 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ffd69120-45fc-4ebf-9416-f2da9352ccb1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:05.041725 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ffd69120-45fc-4ebf-9416-f2da9352ccb1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:05.115068 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ffd69120-45fc-4ebf-9416-f2da9352ccb1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:05.123671 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ffd69120-45fc-4ebf-9416-f2da9352ccb1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1215 microversion: 2.1 time: 0.102414 Jun 29 08:39:05.124400 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 246/516] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:05 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:06.141469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-707b1af9-1e77-46e6-9469-f73c8bcab14c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:06.142098 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-707b1af9-1e77-46e6-9469-f73c8bcab14c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:06.148168 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-707b1af9-1e77-46e6-9469-f73c8bcab14c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:06.148605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-707b1af9-1e77-46e6-9469-f73c8bcab14c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:06.149362 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-707b1af9-1e77-46e6-9469-f73c8bcab14c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:06.149827 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-707b1af9-1e77-46e6-9469-f73c8bcab14c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:06.212398 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-707b1af9-1e77-46e6-9469-f73c8bcab14c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:06.222776 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-707b1af9-1e77-46e6-9469-f73c8bcab14c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1215 microversion: 2.1 time: 0.084918 Jun 29 08:39:06.223515 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 271/517] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:06 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:07.241138 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8e5be93d-cd70-4466-9002-4faf8a99d961 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:07.241752 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8e5be93d-cd70-4466-9002-4faf8a99d961 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:07.248261 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8e5be93d-cd70-4466-9002-4faf8a99d961 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:07.248698 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8e5be93d-cd70-4466-9002-4faf8a99d961 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:07.249447 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8e5be93d-cd70-4466-9002-4faf8a99d961 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:07.249871 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8e5be93d-cd70-4466-9002-4faf8a99d961 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:07.319971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8e5be93d-cd70-4466-9002-4faf8a99d961 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:07.327704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8e5be93d-cd70-4466-9002-4faf8a99d961 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1277 microversion: 2.1 time: 0.090448 Jun 29 08:39:07.328258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 247/518] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:07 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:08.274380 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-5a622e39-0c6f-4737-8c8a-ecd40fa68788 req-a36629c1-fdc9-4766-b369-aad2a7fad421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd35412-acc9-4da0-8b0b-be5ce54315de", "tag": "73addd5f-6f81-4593-9ca8-8245c59b15e3"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:39:08.282983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-5a622e39-0c6f-4737-8c8a-ecd40fa68788 req-a36629c1-fdc9-4766-b369-aad2a7fad421 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:08.283365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-5a622e39-0c6f-4737-8c8a-ecd40fa68788 req-a36629c1-fdc9-4766-b369-aad2a7fad421 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:08.294714 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-5a622e39-0c6f-4737-8c8a-ecd40fa68788 req-a36629c1-fdc9-4766-b369-aad2a7fad421 service nova] Creating event network-changed:73addd5f-6f81-4593-9ca8-8245c59b15e3 for instance 8fd35412-acc9-4da0-8b0b-be5ce54315de on hv-cinder-79760 Jun 29 08:39:08.299620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-5a622e39-0c6f-4737-8c8a-ecd40fa68788 req-a36629c1-fdc9-4766-b369-aad2a7fad421 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029032 Jun 29 08:39:08.300234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 272/519] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:39:08.349296 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d701b7b2-55d3-468e-b587-1941e11941f6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:08.350255 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d701b7b2-55d3-468e-b587-1941e11941f6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:08.361445 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d701b7b2-55d3-468e-b587-1941e11941f6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:08.362173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d701b7b2-55d3-468e-b587-1941e11941f6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:08.363499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d701b7b2-55d3-468e-b587-1941e11941f6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:08.364267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d701b7b2-55d3-468e-b587-1941e11941f6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:08.498718 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d701b7b2-55d3-468e-b587-1941e11941f6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:08.506446 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d701b7b2-55d3-468e-b587-1941e11941f6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.163810 Jun 29 08:39:08.507125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 248/520] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:08 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:09.528707 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e9785c44-f54a-492a-ba92-054e3f44d765 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:09.529672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e9785c44-f54a-492a-ba92-054e3f44d765 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:09.539127 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9785c44-f54a-492a-ba92-054e3f44d765 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:09.539850 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9785c44-f54a-492a-ba92-054e3f44d765 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:09.540901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9785c44-f54a-492a-ba92-054e3f44d765 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:09.541361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9785c44-f54a-492a-ba92-054e3f44d765 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:09.680061 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e9785c44-f54a-492a-ba92-054e3f44d765 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:09.687748 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e9785c44-f54a-492a-ba92-054e3f44d765 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.165850 Jun 29 08:39:09.688306 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 273/521] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:09 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:10.707936 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1d009dd7-7a77-436b-bbe1-a07c658e2390 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:10.708853 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1d009dd7-7a77-436b-bbe1-a07c658e2390 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:10.712410 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:39:10.721269 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1d009dd7-7a77-436b-bbe1-a07c658e2390 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:10.721846 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1d009dd7-7a77-436b-bbe1-a07c658e2390 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:10.723077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1d009dd7-7a77-436b-bbe1-a07c658e2390 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:10.723759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1d009dd7-7a77-436b-bbe1-a07c658e2390 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:10.728650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=61 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:39:10.864468 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1d009dd7-7a77-436b-bbe1-a07c658e2390 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:10.872558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1d009dd7-7a77-436b-bbe1-a07c658e2390 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.170650 Jun 29 08:39:10.873122 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 249/522] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:10 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:11.890228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9d2711ec-b75d-4d99-a054-1707c143ab48 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:11.890828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9d2711ec-b75d-4d99-a054-1707c143ab48 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:11.897248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d2711ec-b75d-4d99-a054-1707c143ab48 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:11.898318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d2711ec-b75d-4d99-a054-1707c143ab48 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:11.899120 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d2711ec-b75d-4d99-a054-1707c143ab48 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:11.899544 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d2711ec-b75d-4d99-a054-1707c143ab48 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:11.902409 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=65 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:39:12.043135 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9d2711ec-b75d-4d99-a054-1707c143ab48 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:12.050921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9d2711ec-b75d-4d99-a054-1707c143ab48 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.164641 Jun 29 08:39:12.051481 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 274/523] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:11 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:13.068680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6eb97e79-11a1-4351-90cb-ddae8fbdda9f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:13.069381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6eb97e79-11a1-4351-90cb-ddae8fbdda9f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:13.071534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:39:13.078298 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6eb97e79-11a1-4351-90cb-ddae8fbdda9f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:13.079362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6eb97e79-11a1-4351-90cb-ddae8fbdda9f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:13.080339 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6eb97e79-11a1-4351-90cb-ddae8fbdda9f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:13.080858 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6eb97e79-11a1-4351-90cb-ddae8fbdda9f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:13.459487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6eb97e79-11a1-4351-90cb-ddae8fbdda9f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:13.468203 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6eb97e79-11a1-4351-90cb-ddae8fbdda9f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.403670 Jun 29 08:39:13.468853 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 250/524] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:13 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:14.486209 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-050dff93-c344-4b7f-88c7-6df312eb3fd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:14.486828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-050dff93-c344-4b7f-88c7-6df312eb3fd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:14.488685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:39:14.489328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:39:14.495108 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-050dff93-c344-4b7f-88c7-6df312eb3fd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:14.495548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-050dff93-c344-4b7f-88c7-6df312eb3fd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:14.496295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-050dff93-c344-4b7f-88c7-6df312eb3fd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:14.496714 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-050dff93-c344-4b7f-88c7-6df312eb3fd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:14.638353 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-050dff93-c344-4b7f-88c7-6df312eb3fd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:14.646068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-050dff93-c344-4b7f-88c7-6df312eb3fd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.163746 Jun 29 08:39:14.646609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 275/525] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:14 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:15.663463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f2780ea5-4ed0-4efa-808e-281b561b7049 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:15.664238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f2780ea5-4ed0-4efa-808e-281b561b7049 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:15.672308 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f2780ea5-4ed0-4efa-808e-281b561b7049 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:15.672756 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f2780ea5-4ed0-4efa-808e-281b561b7049 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:15.673791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f2780ea5-4ed0-4efa-808e-281b561b7049 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:15.674276 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f2780ea5-4ed0-4efa-808e-281b561b7049 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:15.808608 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f2780ea5-4ed0-4efa-808e-281b561b7049 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:15.816396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f2780ea5-4ed0-4efa-808e-281b561b7049 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.157276 Jun 29 08:39:15.816947 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 251/526] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:15 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:16.835182 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-84b7fca7-0e6c-4c19-9a1a-47f26fd12d92 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:16.835690 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-84b7fca7-0e6c-4c19-9a1a-47f26fd12d92 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:16.842665 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-84b7fca7-0e6c-4c19-9a1a-47f26fd12d92 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:16.843813 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-84b7fca7-0e6c-4c19-9a1a-47f26fd12d92 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:16.844838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-84b7fca7-0e6c-4c19-9a1a-47f26fd12d92 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:16.845272 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-84b7fca7-0e6c-4c19-9a1a-47f26fd12d92 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:16.977473 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-84b7fca7-0e6c-4c19-9a1a-47f26fd12d92 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:16.985399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-84b7fca7-0e6c-4c19-9a1a-47f26fd12d92 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.154477 Jun 29 08:39:16.985985 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 276/527] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:16 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:39:18.002548 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-07d7eefe-9da5-42b7-8783-47e4bb4bfaf5 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:18.003247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-07d7eefe-9da5-42b7-8783-47e4bb4bfaf5 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:18.009848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-07d7eefe-9da5-42b7-8783-47e4bb4bfaf5 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:18.010282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-07d7eefe-9da5-42b7-8783-47e4bb4bfaf5 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:18.011060 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-07d7eefe-9da5-42b7-8783-47e4bb4bfaf5 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:18.011488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-07d7eefe-9da5-42b7-8783-47e4bb4bfaf5 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:18.146716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-07d7eefe-9da5-42b7-8783-47e4bb4bfaf5 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:18.154273 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-07d7eefe-9da5-42b7-8783-47e4bb4bfaf5 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.155854 Jun 29 08:39:18.154875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 252/528] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:17 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:19.172300 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-189bc347-63a3-4e33-aca5-e70f7530e62f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:19.173079 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-189bc347-63a3-4e33-aca5-e70f7530e62f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:19.180203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-189bc347-63a3-4e33-aca5-e70f7530e62f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:19.180660 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-189bc347-63a3-4e33-aca5-e70f7530e62f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:19.181431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-189bc347-63a3-4e33-aca5-e70f7530e62f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:19.181859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-189bc347-63a3-4e33-aca5-e70f7530e62f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:19.320932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-189bc347-63a3-4e33-aca5-e70f7530e62f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:19.328308 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-189bc347-63a3-4e33-aca5-e70f7530e62f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.160169 Jun 29 08:39:19.328868 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 277/529] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:19 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:20.347387 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-68f940e3-5d3d-4313-81b2-299cdcd56eed tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:20.348066 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-68f940e3-5d3d-4313-81b2-299cdcd56eed tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:20.355264 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68f940e3-5d3d-4313-81b2-299cdcd56eed tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:20.355681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68f940e3-5d3d-4313-81b2-299cdcd56eed tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:20.356596 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68f940e3-5d3d-4313-81b2-299cdcd56eed tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:20.357223 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68f940e3-5d3d-4313-81b2-299cdcd56eed tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:20.502625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-68f940e3-5d3d-4313-81b2-299cdcd56eed tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:20.512171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-68f940e3-5d3d-4313-81b2-299cdcd56eed tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.168767 Jun 29 08:39:20.513133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 253/530] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:20 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:21.529360 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dff0cd64-f168-458d-8edb-252d2de3d574 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:21.530357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dff0cd64-f168-458d-8edb-252d2de3d574 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:21.543694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dff0cd64-f168-458d-8edb-252d2de3d574 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:21.544553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dff0cd64-f168-458d-8edb-252d2de3d574 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:21.545876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dff0cd64-f168-458d-8edb-252d2de3d574 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:21.546628 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dff0cd64-f168-458d-8edb-252d2de3d574 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:21.693705 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dff0cd64-f168-458d-8edb-252d2de3d574 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:21.702487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dff0cd64-f168-458d-8edb-252d2de3d574 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.177223 Jun 29 08:39:21.705526 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 278/531] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:21 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:22.720662 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-71ba32ed-9922-4c64-b47d-d3fa8dcc7d55 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:22.721307 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-71ba32ed-9922-4c64-b47d-d3fa8dcc7d55 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:22.728518 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-71ba32ed-9922-4c64-b47d-d3fa8dcc7d55 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:22.728984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-71ba32ed-9922-4c64-b47d-d3fa8dcc7d55 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:22.730726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-71ba32ed-9922-4c64-b47d-d3fa8dcc7d55 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:22.731247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-71ba32ed-9922-4c64-b47d-d3fa8dcc7d55 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:22.811697 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-4488539a-b6b6-43d9-a2dc-750f73b2d384 req-8784a33f-1551-4a9d-8b8d-1924d8cc9e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd35412-acc9-4da0-8b0b-be5ce54315de", "name": "network-vif-plugged", "status": "completed", "tag": "73addd5f-6f81-4593-9ca8-8245c59b15e3"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:39:22.823981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:39:22.826314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-4488539a-b6b6-43d9-a2dc-750f73b2d384 req-8784a33f-1551-4a9d-8b8d-1924d8cc9e23 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:22.827167 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-4488539a-b6b6-43d9-a2dc-750f73b2d384 req-8784a33f-1551-4a9d-8b8d-1924d8cc9e23 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:22.851108 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-4488539a-b6b6-43d9-a2dc-750f73b2d384 req-8784a33f-1551-4a9d-8b8d-1924d8cc9e23 service nova] Creating event network-vif-plugged:73addd5f-6f81-4593-9ca8-8245c59b15e3 for instance 8fd35412-acc9-4da0-8b0b-be5ce54315de on hv-cinder-79760 Jun 29 08:39:22.866176 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-4488539a-b6b6-43d9-a2dc-750f73b2d384 req-8784a33f-1551-4a9d-8b8d-1924d8cc9e23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061174 Jun 29 08:39:22.867420 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 279/532] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:39:22.901747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-71ba32ed-9922-4c64-b47d-d3fa8dcc7d55 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:22.912980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-71ba32ed-9922-4c64-b47d-d3fa8dcc7d55 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.196856 Jun 29 08:39:22.913770 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 254/533] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:22 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:23.930093 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74c41e33-a1fb-4a5a-93ee-8037a9670cd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:23.930800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-74c41e33-a1fb-4a5a-93ee-8037a9670cd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:23.941513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74c41e33-a1fb-4a5a-93ee-8037a9670cd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:23.941877 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74c41e33-a1fb-4a5a-93ee-8037a9670cd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:23.942641 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74c41e33-a1fb-4a5a-93ee-8037a9670cd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:23.943134 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74c41e33-a1fb-4a5a-93ee-8037a9670cd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:24.096306 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-74c41e33-a1fb-4a5a-93ee-8037a9670cd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:24.104566 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-74c41e33-a1fb-4a5a-93ee-8037a9670cd7 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.178708 Jun 29 08:39:24.105153 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 280/534] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:23 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:25.122255 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-57aa79ff-c98f-4992-ac1b-30ac1480a33e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:25.123565 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-57aa79ff-c98f-4992-ac1b-30ac1480a33e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:25.130902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57aa79ff-c98f-4992-ac1b-30ac1480a33e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:25.131349 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57aa79ff-c98f-4992-ac1b-30ac1480a33e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:25.132309 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57aa79ff-c98f-4992-ac1b-30ac1480a33e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:25.132891 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-57aa79ff-c98f-4992-ac1b-30ac1480a33e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:25.351828 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-57aa79ff-c98f-4992-ac1b-30ac1480a33e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:25.368424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-57aa79ff-c98f-4992-ac1b-30ac1480a33e tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1319 microversion: 2.1 time: 0.249727 Jun 29 08:39:25.370491 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 255/535] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:25 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:26.387043 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bbb8c207-b95f-4f56-a2a0-5f8fffc22761 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:39:26.387764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bbb8c207-b95f-4f56-a2a0-5f8fffc22761 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:39:26.395193 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbb8c207-b95f-4f56-a2a0-5f8fffc22761 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:26.395781 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbb8c207-b95f-4f56-a2a0-5f8fffc22761 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:26.396658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbb8c207-b95f-4f56-a2a0-5f8fffc22761 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:39:26.397182 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbb8c207-b95f-4f56-a2a0-5f8fffc22761 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:39:26.723259 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bbb8c207-b95f-4f56-a2a0-5f8fffc22761 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:39:26.731574 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bbb8c207-b95f-4f56-a2a0-5f8fffc22761 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1508 microversion: 2.1 time: 0.349962 Jun 29 08:39:26.746866 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 281/536] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:39:26 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:39:29.049396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-49b2ef3e-0612-465f-9702-c007a14988d9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Action: 'create', calling method: .version_select at 0x7fade4252a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1732324740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpvPkUyJlJwGrzl2NATLfYZBNX54qI8kyEegdW6E2yaCpjyjyHvdSQo4UMYE+MtCBQ/GlkCrUfLM7l39yhIj5fM0D4kNa8uTrlhcU1pNGNDx/ri8nW9kzyOTA1/J5fntQ=="}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:39:29.069944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-49b2ef3e-0612-465f-9702-c007a14988d9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Getting quotas for project fa6da3e4a87442299d21f3b55dfe3e9f. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:39:29.073901 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-49b2ef3e-0612-465f-9702-c007a14988d9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Getting quotas for user 1b2337595cbb40608d6bc485889d8bc6 and project fa6da3e4a87442299d21f3b55dfe3e9f. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:39:29.104232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-49b2ef3e-0612-465f-9702-c007a14988d9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.287442 Jun 29 08:39:29.105231 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 256/537] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:39:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:08.762519 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-745c3879-9cd5-4ad8-8a2f-1dc1fc75d516 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "172bab50-ccf2-4bb6-a293-a8643dc8f4c4", "device": "/dev/sdb"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:08.764124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-745c3879-9cd5-4ad8-8a2f-1dc1fc75d516 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:08.766251 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=5 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:08.766943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=43 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:08.772624 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-745c3879-9cd5-4ad8-8a2f-1dc1fc75d516 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:08.773057 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-745c3879-9cd5-4ad8-8a2f-1dc1fc75d516 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:08.774146 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-745c3879-9cd5-4ad8-8a2f-1dc1fc75d516 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:08.774869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-745c3879-9cd5-4ad8-8a2f-1dc1fc75d516 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:09.199279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-745c3879-9cd5-4ad8-8a2f-1dc1fc75d516 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "POST /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440643 Jun 29 08:40:09.199890 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 282/538] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:40:08 2022] POST /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:11.080412 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=41 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:11.081155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=4 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:11.081759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:11.085977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-298416002", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1732324740", "security_groups": [{"name": "tempest-secgroup-smoke-633675277"}], "block_device_mapping_v2": [{"uuid": "34923cc0-acae-4fee-b890-8b033059c577", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "95cdc108-572d-40ee-b588-3458605e5b77"}]}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:11.262154 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] validate_networks() for [('95cdc108-572d-40ee-b588-3458605e5b77', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:40:11.640609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:40:11.641039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:40:11.641513 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:40:11.641917 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:40:11.642326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:40:11.651545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:11.651988 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:11.652835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:11.653247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:11.669383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Getting quotas for project fa6da3e4a87442299d21f3b55dfe3e9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:40:11.673263 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Getting quotas for user 1b2337595cbb40608d6bc485889d8bc6 and project fa6da3e4a87442299d21f3b55dfe3e9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:40:11.745326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:40:11.747443 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='34923cc0-acae-4fee-b890-8b033059c577',volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:40:11.883064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-90e3b6c5-fd19-41b0-ac82-cb56514f7256 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.804061 Jun 29 08:40:11.883699 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 257/539] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:40:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:40:11.895267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7e47e574-bc6f-4002-874a-ed5b71ead3f1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:11.895987 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7e47e574-bc6f-4002-874a-ed5b71ead3f1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:11.950348 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e47e574-bc6f-4002-874a-ed5b71ead3f1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:11.957359 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7e47e574-bc6f-4002-874a-ed5b71ead3f1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1094 microversion: 2.1 time: 0.067175 Jun 29 08:40:11.957932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 283/540] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:11 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:40:12.979420 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7df1b674-7b5a-4647-836d-940a46c07a88 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:12.980386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7df1b674-7b5a-4647-836d-940a46c07a88 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:12.990113 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7df1b674-7b5a-4647-836d-940a46c07a88 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:12.990552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7df1b674-7b5a-4647-836d-940a46c07a88 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:12.991351 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7df1b674-7b5a-4647-836d-940a46c07a88 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:12.991778 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7df1b674-7b5a-4647-836d-940a46c07a88 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:13.060080 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7df1b674-7b5a-4647-836d-940a46c07a88 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:13.067897 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7df1b674-7b5a-4647-836d-940a46c07a88 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1192 microversion: 2.1 time: 0.095814 Jun 29 08:40:13.068657 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 258/541] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:12 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:14.087788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-46c57b09-f923-4fb7-a19b-0cbb91561357 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:14.089920 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-46c57b09-f923-4fb7-a19b-0cbb91561357 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:14.098799 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-46c57b09-f923-4fb7-a19b-0cbb91561357 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:14.099513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-46c57b09-f923-4fb7-a19b-0cbb91561357 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:14.100614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-46c57b09-f923-4fb7-a19b-0cbb91561357 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:14.101191 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-46c57b09-f923-4fb7-a19b-0cbb91561357 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:14.309138 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-46c57b09-f923-4fb7-a19b-0cbb91561357 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:14.317084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-46c57b09-f923-4fb7-a19b-0cbb91561357 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1277 microversion: 2.1 time: 0.235327 Jun 29 08:40:14.323145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 284/542] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:14 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:40:14.653628 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-879c5f7b-8a3f-4419-974d-5a71abb979ad req-2faf4a6a-7d1e-4c3f-9af0-6cbab3d75f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d86a45-eb3d-4489-aa2e-c9be196427ee", "tag": "2fca60b0-747a-4269-9d67-e79a476ee76a"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:14.665287 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-879c5f7b-8a3f-4419-974d-5a71abb979ad req-2faf4a6a-7d1e-4c3f-9af0-6cbab3d75f61 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:14.666012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-879c5f7b-8a3f-4419-974d-5a71abb979ad req-2faf4a6a-7d1e-4c3f-9af0-6cbab3d75f61 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:14.679863 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-879c5f7b-8a3f-4419-974d-5a71abb979ad req-2faf4a6a-7d1e-4c3f-9af0-6cbab3d75f61 service nova] Creating event network-changed:2fca60b0-747a-4269-9d67-e79a476ee76a for instance f3d86a45-eb3d-4489-aa2e-c9be196427ee on hv-cinder-79760 Jun 29 08:40:14.685476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-879c5f7b-8a3f-4419-974d-5a71abb979ad req-2faf4a6a-7d1e-4c3f-9af0-6cbab3d75f61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035376 Jun 29 08:40:14.686450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 259/543] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:15.333701 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e6013fa1-1384-403c-8da1-aa28ee45610c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:15.334432 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e6013fa1-1384-403c-8da1-aa28ee45610c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:15.341594 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6013fa1-1384-403c-8da1-aa28ee45610c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:15.342027 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6013fa1-1384-403c-8da1-aa28ee45610c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:15.342808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6013fa1-1384-403c-8da1-aa28ee45610c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:15.343232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6013fa1-1384-403c-8da1-aa28ee45610c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:15.486742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e6013fa1-1384-403c-8da1-aa28ee45610c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:15.495002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e6013fa1-1384-403c-8da1-aa28ee45610c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1277 microversion: 2.1 time: 0.165249 Jun 29 08:40:15.495575 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 285/544] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:15 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:16.513484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-262a4cb3-bdb5-41d3-99b1-8372005ff3ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:16.514187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-262a4cb3-bdb5-41d3-99b1-8372005ff3ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:16.521632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-262a4cb3-bdb5-41d3-99b1-8372005ff3ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:16.522077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-262a4cb3-bdb5-41d3-99b1-8372005ff3ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:16.522879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-262a4cb3-bdb5-41d3-99b1-8372005ff3ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:16.523309 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-262a4cb3-bdb5-41d3-99b1-8372005ff3ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:16.745039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-262a4cb3-bdb5-41d3-99b1-8372005ff3ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:16.752647 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-262a4cb3-bdb5-41d3-99b1-8372005ff3ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1277 microversion: 2.1 time: 0.244006 Jun 29 08:40:16.753203 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 260/545] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:16 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:17.770001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-93bd5a25-355f-4c67-b978-328e1928e837 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:17.770627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-93bd5a25-355f-4c67-b978-328e1928e837 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:17.777529 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-93bd5a25-355f-4c67-b978-328e1928e837 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:17.777980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-93bd5a25-355f-4c67-b978-328e1928e837 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:17.778726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-93bd5a25-355f-4c67-b978-328e1928e837 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:17.779166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-93bd5a25-355f-4c67-b978-328e1928e837 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:17.914104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-93bd5a25-355f-4c67-b978-328e1928e837 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:17.922782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-93bd5a25-355f-4c67-b978-328e1928e837 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.156610 Jun 29 08:40:17.923817 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 286/546] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:17 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:40:18.942615 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a55820cb-9b86-47dd-aac5-f57415c734da tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:18.943418 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a55820cb-9b86-47dd-aac5-f57415c734da tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:18.952006 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a55820cb-9b86-47dd-aac5-f57415c734da tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:18.952555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a55820cb-9b86-47dd-aac5-f57415c734da tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:18.953487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a55820cb-9b86-47dd-aac5-f57415c734da tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:18.954016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a55820cb-9b86-47dd-aac5-f57415c734da tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:19.087496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a55820cb-9b86-47dd-aac5-f57415c734da tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:19.095866 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a55820cb-9b86-47dd-aac5-f57415c734da tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.158108 Jun 29 08:40:19.096432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 261/547] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:18 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:20.117257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f2678259-c91d-4769-9956-a19717d5f546 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:20.118314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f2678259-c91d-4769-9956-a19717d5f546 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:20.129493 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f2678259-c91d-4769-9956-a19717d5f546 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:20.130170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f2678259-c91d-4769-9956-a19717d5f546 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:20.131745 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f2678259-c91d-4769-9956-a19717d5f546 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:20.132318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f2678259-c91d-4769-9956-a19717d5f546 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:20.274534 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f2678259-c91d-4769-9956-a19717d5f546 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:20.282102 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f2678259-c91d-4769-9956-a19717d5f546 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.171558 Jun 29 08:40:20.282667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 287/548] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:20 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:21.303708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-77b6f698-eb36-4287-8f87-bf3691069c6a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:21.305177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-77b6f698-eb36-4287-8f87-bf3691069c6a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:21.316595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77b6f698-eb36-4287-8f87-bf3691069c6a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:21.316980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77b6f698-eb36-4287-8f87-bf3691069c6a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:21.318253 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77b6f698-eb36-4287-8f87-bf3691069c6a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:21.319095 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77b6f698-eb36-4287-8f87-bf3691069c6a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:21.452365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-77b6f698-eb36-4287-8f87-bf3691069c6a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:21.461823 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-77b6f698-eb36-4287-8f87-bf3691069c6a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.164686 Jun 29 08:40:21.462572 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 262/549] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:21 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:22.484071 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-589781e5-aee3-48f6-98b8-6f95e1fcb6bf tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:22.484673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-589781e5-aee3-48f6-98b8-6f95e1fcb6bf tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:22.487138 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:22.492798 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-589781e5-aee3-48f6-98b8-6f95e1fcb6bf tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:22.493267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-589781e5-aee3-48f6-98b8-6f95e1fcb6bf tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:22.494012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-589781e5-aee3-48f6-98b8-6f95e1fcb6bf tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:22.494432 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-589781e5-aee3-48f6-98b8-6f95e1fcb6bf tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:22.643094 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-589781e5-aee3-48f6-98b8-6f95e1fcb6bf tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:22.651333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-589781e5-aee3-48f6-98b8-6f95e1fcb6bf tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.171197 Jun 29 08:40:22.651897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 288/550] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:22 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:23.676254 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dec1b301-c279-4618-9472-e04fe1e69f92 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:23.677030 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-dec1b301-c279-4618-9472-e04fe1e69f92 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:23.679521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:23.680362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:23.689305 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dec1b301-c279-4618-9472-e04fe1e69f92 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:23.689881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dec1b301-c279-4618-9472-e04fe1e69f92 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:23.690873 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dec1b301-c279-4618-9472-e04fe1e69f92 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:23.691430 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dec1b301-c279-4618-9472-e04fe1e69f92 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:23.834254 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dec1b301-c279-4618-9472-e04fe1e69f92 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:23.842289 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dec1b301-c279-4618-9472-e04fe1e69f92 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.171200 Jun 29 08:40:23.842882 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 263/551] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:23 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:24.861016 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c7c4ddc4-1f53-4a96-97a1-f59313b2b85f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:24.861737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c7c4ddc4-1f53-4a96-97a1-f59313b2b85f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:24.870427 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7c4ddc4-1f53-4a96-97a1-f59313b2b85f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:24.870932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7c4ddc4-1f53-4a96-97a1-f59313b2b85f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:24.871684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7c4ddc4-1f53-4a96-97a1-f59313b2b85f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:24.872099 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7c4ddc4-1f53-4a96-97a1-f59313b2b85f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:25.015598 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c7c4ddc4-1f53-4a96-97a1-f59313b2b85f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:25.023603 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c7c4ddc4-1f53-4a96-97a1-f59313b2b85f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.167495 Jun 29 08:40:25.024194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 289/552] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:24 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:25.550329 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e1b5c5ef-7013-4d12-afcd-b289466bb822 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:25.551372 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e1b5c5ef-7013-4d12-afcd-b289466bb822 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:25.557960 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e1b5c5ef-7013-4d12-afcd-b289466bb822 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:25.558396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e1b5c5ef-7013-4d12-afcd-b289466bb822 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:25.559154 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e1b5c5ef-7013-4d12-afcd-b289466bb822 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:25.559611 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e1b5c5ef-7013-4d12-afcd-b289466bb822 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:26.042461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-80d28c06-5769-468e-8482-6fddd5c15b79 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:26.043119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-80d28c06-5769-468e-8482-6fddd5c15b79 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:26.050118 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80d28c06-5769-468e-8482-6fddd5c15b79 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:26.050558 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80d28c06-5769-468e-8482-6fddd5c15b79 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:26.051336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80d28c06-5769-468e-8482-6fddd5c15b79 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:26.051761 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80d28c06-5769-468e-8482-6fddd5c15b79 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:26.188762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-80d28c06-5769-468e-8482-6fddd5c15b79 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:26.200055 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-80d28c06-5769-468e-8482-6fddd5c15b79 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.162024 Jun 29 08:40:26.200855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 290/553] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:26 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:27.221641 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7a315a45-82a3-46c8-bb74-9b3b9a8bda18 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:27.222783 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7a315a45-82a3-46c8-bb74-9b3b9a8bda18 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:27.231435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7a315a45-82a3-46c8-bb74-9b3b9a8bda18 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:27.231874 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7a315a45-82a3-46c8-bb74-9b3b9a8bda18 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:27.232633 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7a315a45-82a3-46c8-bb74-9b3b9a8bda18 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:27.233057 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7a315a45-82a3-46c8-bb74-9b3b9a8bda18 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:27.369425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7a315a45-82a3-46c8-bb74-9b3b9a8bda18 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:27.377514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7a315a45-82a3-46c8-bb74-9b3b9a8bda18 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.162840 Jun 29 08:40:27.378083 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 291/554] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:27 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:28.398508 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-333cd701-f5ed-417b-860d-5efc4cb16713 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:28.399580 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-333cd701-f5ed-417b-860d-5efc4cb16713 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:28.407240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-333cd701-f5ed-417b-860d-5efc4cb16713 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:28.407677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-333cd701-f5ed-417b-860d-5efc4cb16713 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:28.408426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-333cd701-f5ed-417b-860d-5efc4cb16713 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:28.408847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-333cd701-f5ed-417b-860d-5efc4cb16713 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:28.543216 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-333cd701-f5ed-417b-860d-5efc4cb16713 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:28.553154 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-333cd701-f5ed-417b-860d-5efc4cb16713 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.160830 Jun 29 08:40:28.553790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 292/555] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:28 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:29.524731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e1b5c5ef-7013-4d12-afcd-b289466bb822 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/action" status: 200 len: 28951 microversion: 2.1 time: 4.092375 Jun 29 08:40:29.525432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 264/556] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:40:25 2022] POST /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/action => generated 28951 bytes in 4094 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 08:40:29.570465 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6c240f1a-d1ec-4fae-b8ac-6c417518a3fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:29.571414 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6c240f1a-d1ec-4fae-b8ac-6c417518a3fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:29.578317 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c240f1a-d1ec-4fae-b8ac-6c417518a3fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:29.578781 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c240f1a-d1ec-4fae-b8ac-6c417518a3fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:29.579542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c240f1a-d1ec-4fae-b8ac-6c417518a3fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:29.579957 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c240f1a-d1ec-4fae-b8ac-6c417518a3fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:29.719808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6c240f1a-d1ec-4fae-b8ac-6c417518a3fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:29.728041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6c240f1a-d1ec-4fae-b8ac-6c417518a3fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.161577 Jun 29 08:40:29.728610 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 293/557] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:29 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:30.745873 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e8df6aac-7c6c-4384-963b-9239956bb25c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:30.746593 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e8df6aac-7c6c-4384-963b-9239956bb25c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:30.754166 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e8df6aac-7c6c-4384-963b-9239956bb25c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:30.754611 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e8df6aac-7c6c-4384-963b-9239956bb25c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:30.755414 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e8df6aac-7c6c-4384-963b-9239956bb25c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:30.755842 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e8df6aac-7c6c-4384-963b-9239956bb25c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:30.903728 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e8df6aac-7c6c-4384-963b-9239956bb25c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:30.915211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e8df6aac-7c6c-4384-963b-9239956bb25c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.173622 Jun 29 08:40:30.915846 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 265/558] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:30 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:31.941283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2339d795-9385-40d8-bdf3-e002c0e6f6b1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:31.942189 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2339d795-9385-40d8-bdf3-e002c0e6f6b1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:31.951018 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2339d795-9385-40d8-bdf3-e002c0e6f6b1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:31.951454 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2339d795-9385-40d8-bdf3-e002c0e6f6b1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:31.952204 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2339d795-9385-40d8-bdf3-e002c0e6f6b1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:31.952626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2339d795-9385-40d8-bdf3-e002c0e6f6b1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:32.092653 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2339d795-9385-40d8-bdf3-e002c0e6f6b1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:32.105019 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2339d795-9385-40d8-bdf3-e002c0e6f6b1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.169913 Jun 29 08:40:32.105927 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 294/559] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:31 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:33.131346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8d0afa41-bf0c-4372-b71f-2485a714f864 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:33.132278 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8d0afa41-bf0c-4372-b71f-2485a714f864 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:33.143636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8d0afa41-bf0c-4372-b71f-2485a714f864 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:33.144358 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8d0afa41-bf0c-4372-b71f-2485a714f864 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:33.145594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8d0afa41-bf0c-4372-b71f-2485a714f864 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:33.146299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8d0afa41-bf0c-4372-b71f-2485a714f864 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:33.288626 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8d0afa41-bf0c-4372-b71f-2485a714f864 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:33.296409 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8d0afa41-bf0c-4372-b71f-2485a714f864 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.171637 Jun 29 08:40:33.296977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 266/560] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:33 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:34.313516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-de804b69-f810-41e8-acab-2754e61e95fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:34.314116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-de804b69-f810-41e8-acab-2754e61e95fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:34.321001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de804b69-f810-41e8-acab-2754e61e95fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:34.321460 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de804b69-f810-41e8-acab-2754e61e95fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:34.322215 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de804b69-f810-41e8-acab-2754e61e95fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:34.322667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de804b69-f810-41e8-acab-2754e61e95fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:34.456162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-de804b69-f810-41e8-acab-2754e61e95fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:34.464604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-de804b69-f810-41e8-acab-2754e61e95fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.155039 Jun 29 08:40:34.465517 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 295/561] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:34 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:35.483514 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-182aa328-51df-4e5b-a86c-feb403584fdc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:35.484144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-182aa328-51df-4e5b-a86c-feb403584fdc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:35.491144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-182aa328-51df-4e5b-a86c-feb403584fdc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:35.491582 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-182aa328-51df-4e5b-a86c-feb403584fdc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:35.492329 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-182aa328-51df-4e5b-a86c-feb403584fdc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:35.492749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-182aa328-51df-4e5b-a86c-feb403584fdc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:35.639586 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-182aa328-51df-4e5b-a86c-feb403584fdc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:35.651897 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-182aa328-51df-4e5b-a86c-feb403584fdc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.171678 Jun 29 08:40:35.653060 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 267/562] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:35 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:35.902762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-32fdc21a-54cf-4d04-a481-2e870f5f1ca7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:35.903297 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-32fdc21a-54cf-4d04-a481-2e870f5f1ca7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:35.910299 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32fdc21a-54cf-4d04-a481-2e870f5f1ca7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:35.910731 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32fdc21a-54cf-4d04-a481-2e870f5f1ca7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:35.911515 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32fdc21a-54cf-4d04-a481-2e870f5f1ca7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:35.911932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32fdc21a-54cf-4d04-a481-2e870f5f1ca7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:35.941122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-32fdc21a-54cf-4d04-a481-2e870f5f1ca7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/ips" status: 200 len: 149 microversion: 2.1 time: 0.042586 Jun 29 08:40:35.941679 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 296/563] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:40:35 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:36.676996 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a2a9fb4f-84d5-4df9-a6c1-2a3eca518e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:36.677649 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a2a9fb4f-84d5-4df9-a6c1-2a3eca518e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:36.686171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2a9fb4f-84d5-4df9-a6c1-2a3eca518e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:36.686922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2a9fb4f-84d5-4df9-a6c1-2a3eca518e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:36.687686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2a9fb4f-84d5-4df9-a6c1-2a3eca518e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:36.688111 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2a9fb4f-84d5-4df9-a6c1-2a3eca518e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:36.850313 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a2a9fb4f-84d5-4df9-a6c1-2a3eca518e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:36.858211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a2a9fb4f-84d5-4df9-a6c1-2a3eca518e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.187681 Jun 29 08:40:36.858794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 268/564] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:36 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:37.880212 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f383078e-b088-4ee7-a9a7-51dc8948be03 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:37.881157 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f383078e-b088-4ee7-a9a7-51dc8948be03 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:37.890390 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f383078e-b088-4ee7-a9a7-51dc8948be03 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:37.890861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f383078e-b088-4ee7-a9a7-51dc8948be03 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:37.891626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f383078e-b088-4ee7-a9a7-51dc8948be03 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:37.892051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f383078e-b088-4ee7-a9a7-51dc8948be03 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:38.039872 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f383078e-b088-4ee7-a9a7-51dc8948be03 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:38.047804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f383078e-b088-4ee7-a9a7-51dc8948be03 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.174187 Jun 29 08:40:38.048362 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 297/565] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:37 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:38.301130 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ab30ba2f-b86c-417b-b727-46b5c332bc46 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:38.302771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ab30ba2f-b86c-417b-b727-46b5c332bc46 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:38.311122 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ab30ba2f-b86c-417b-b727-46b5c332bc46 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:38.311574 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ab30ba2f-b86c-417b-b727-46b5c332bc46 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:38.312348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ab30ba2f-b86c-417b-b727-46b5c332bc46 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:38.312802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ab30ba2f-b86c-417b-b727-46b5c332bc46 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:38.378776 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6bceb9f3-316d-427c-893c-e03df39fd915 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a504e02f-7328-48dc-adfa-a9d88628ca0a"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:38.379908 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6bceb9f3-316d-427c-893c-e03df39fd915 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:38.385916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6bceb9f3-316d-427c-893c-e03df39fd915 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:38.386359 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6bceb9f3-316d-427c-893c-e03df39fd915 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:38.387321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6bceb9f3-316d-427c-893c-e03df39fd915 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:38.387747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6bceb9f3-316d-427c-893c-e03df39fd915 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:38.405159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:38.414373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ab30ba2f-b86c-417b-b727-46b5c332bc46 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/action" status: 200 len: 28665 microversion: 2.20 time: 0.229730 Jun 29 08:40:38.415041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 269/566] 10.222.0.27 () {62 vars in 1318 bytes} [Wed Jun 29 08:40:38 2022] POST /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/action => generated 28665 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:40:38.667884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6bceb9f3-316d-427c-893c-e03df39fd915 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292908 Jun 29 08:40:38.669389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 298/567] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:40:38 2022] POST /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:40:39.065924 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6e5c5baa-2cca-400e-a2fc-e4e3e8e1376c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:39.066834 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6e5c5baa-2cca-400e-a2fc-e4e3e8e1376c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:39.075354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6e5c5baa-2cca-400e-a2fc-e4e3e8e1376c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:39.076003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6e5c5baa-2cca-400e-a2fc-e4e3e8e1376c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:39.077463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6e5c5baa-2cca-400e-a2fc-e4e3e8e1376c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:39.078088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6e5c5baa-2cca-400e-a2fc-e4e3e8e1376c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:39.092972 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-c498d92e-fb54-4921-868e-242dd4acb112 req-a5e36d7b-07bc-40bf-9ed6-1844ed871e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d86a45-eb3d-4489-aa2e-c9be196427ee", "name": "network-vif-plugged", "status": "completed", "tag": "2fca60b0-747a-4269-9d67-e79a476ee76a"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:39.096503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=37 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:39.110439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-c498d92e-fb54-4921-868e-242dd4acb112 req-a5e36d7b-07bc-40bf-9ed6-1844ed871e2e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:39.110904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-c498d92e-fb54-4921-868e-242dd4acb112 req-a5e36d7b-07bc-40bf-9ed6-1844ed871e2e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:39.131927 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-c498d92e-fb54-4921-868e-242dd4acb112 req-a5e36d7b-07bc-40bf-9ed6-1844ed871e2e service nova] Creating event network-vif-plugged:2fca60b0-747a-4269-9d67-e79a476ee76a for instance f3d86a45-eb3d-4489-aa2e-c9be196427ee on hv-cinder-79760 Jun 29 08:40:39.136972 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-c498d92e-fb54-4921-868e-242dd4acb112 req-a5e36d7b-07bc-40bf-9ed6-1844ed871e2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050930 Jun 29 08:40:39.138636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 299/568] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:39.252470 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6e5c5baa-2cca-400e-a2fc-e4e3e8e1376c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:39.260466 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6e5c5baa-2cca-400e-a2fc-e4e3e8e1376c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.199169 Jun 29 08:40:39.261063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 270/569] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:39 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:40.278108 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8c599079-e494-44d0-9d8c-c1be87b97c8e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:40.278830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8c599079-e494-44d0-9d8c-c1be87b97c8e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:40.285955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c599079-e494-44d0-9d8c-c1be87b97c8e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:40.286386 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c599079-e494-44d0-9d8c-c1be87b97c8e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:40.287183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c599079-e494-44d0-9d8c-c1be87b97c8e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:40.287609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c599079-e494-44d0-9d8c-c1be87b97c8e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:40.420130 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8c599079-e494-44d0-9d8c-c1be87b97c8e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:40.428283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8c599079-e494-44d0-9d8c-c1be87b97c8e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.154447 Jun 29 08:40:40.428839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 300/570] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:40 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:41.270329 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-524c5c66-b6fc-43fa-9e7f-6a2236692f0a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:41.270908 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-524c5c66-b6fc-43fa-9e7f-6a2236692f0a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:41.272932 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:41.278396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-524c5c66-b6fc-43fa-9e7f-6a2236692f0a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:41.278877 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-524c5c66-b6fc-43fa-9e7f-6a2236692f0a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:41.279667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-524c5c66-b6fc-43fa-9e7f-6a2236692f0a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:41.280089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-524c5c66-b6fc-43fa-9e7f-6a2236692f0a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:41.283310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=73 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:40:41.412451 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-524c5c66-b6fc-43fa-9e7f-6a2236692f0a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lazy-loading 'services' on Instance uuid 8fd35412-acc9-4da0-8b0b-be5ce54315de {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:40:41.445387 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-eac6db4d-7560-48be-973f-0c80f9290832 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:41.445910 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-eac6db4d-7560-48be-973f-0c80f9290832 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:41.453196 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eac6db4d-7560-48be-973f-0c80f9290832 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:41.453835 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eac6db4d-7560-48be-973f-0c80f9290832 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:41.454675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eac6db4d-7560-48be-973f-0c80f9290832 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:41.455147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eac6db4d-7560-48be-973f-0c80f9290832 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:41.532622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-524c5c66-b6fc-43fa-9e7f-6a2236692f0a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de/os-volume_attachments/172bab50-ccf2-4bb6-a293-a8643dc8f4c4" status: 202 len: 0 microversion: 2.1 time: 0.266631 Jun 29 08:40:41.533383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 271/571] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:40:41 2022] DELETE /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de/os-volume_attachments/172bab50-ccf2-4bb6-a293-a8643dc8f4c4 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:40:41.592822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-eac6db4d-7560-48be-973f-0c80f9290832 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:41.600285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-eac6db4d-7560-48be-973f-0c80f9290832 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1265 microversion: 2.1 time: 0.158871 Jun 29 08:40:41.600840 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 301/572] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:41 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:42.621759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-634977e4-e2ad-43fc-a171-7b3bd8d9f999 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:42.622959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-634977e4-e2ad-43fc-a171-7b3bd8d9f999 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:42.631112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-634977e4-e2ad-43fc-a171-7b3bd8d9f999 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:42.631555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-634977e4-e2ad-43fc-a171-7b3bd8d9f999 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:42.632316 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-634977e4-e2ad-43fc-a171-7b3bd8d9f999 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:42.632750 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-634977e4-e2ad-43fc-a171-7b3bd8d9f999 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:42.766286 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-634977e4-e2ad-43fc-a171-7b3bd8d9f999 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:42.774138 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-634977e4-e2ad-43fc-a171-7b3bd8d9f999 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1452 microversion: 2.1 time: 0.159377 Jun 29 08:40:42.774722 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 272/573] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:42 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:42.793347 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9b55fdb3-969a-41a1-bd05-fa377869f2fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:42.793935 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9b55fdb3-969a-41a1-bd05-fa377869f2fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:42.801215 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9b55fdb3-969a-41a1-bd05-fa377869f2fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:42.801657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9b55fdb3-969a-41a1-bd05-fa377869f2fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:42.802410 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9b55fdb3-969a-41a1-bd05-fa377869f2fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:42.802863 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9b55fdb3-969a-41a1-bd05-fa377869f2fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:42.939500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9b55fdb3-969a-41a1-bd05-fa377869f2fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:42.946971 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9b55fdb3-969a-41a1-bd05-fa377869f2fa tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1452 microversion: 2.1 time: 0.159397 Jun 29 08:40:42.947543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 302/574] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:42 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:44.904923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-aefd7a4e-f855-4791-ae90-35265bded18d req-f406356d-1770-45f4-b9e9-b31844b8704a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d86a45-eb3d-4489-aa2e-c9be196427ee", "tag": "2fca60b0-747a-4269-9d67-e79a476ee76a"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:44.913649 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-aefd7a4e-f855-4791-ae90-35265bded18d req-f406356d-1770-45f4-b9e9-b31844b8704a service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:44.914078 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-aefd7a4e-f855-4791-ae90-35265bded18d req-f406356d-1770-45f4-b9e9-b31844b8704a service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:44.925206 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-aefd7a4e-f855-4791-ae90-35265bded18d req-f406356d-1770-45f4-b9e9-b31844b8704a service nova] Creating event network-changed:2fca60b0-747a-4269-9d67-e79a476ee76a for instance f3d86a45-eb3d-4489-aa2e-c9be196427ee on hv-cinder-79760 Jun 29 08:40:44.930007 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-aefd7a4e-f855-4791-ae90-35265bded18d req-f406356d-1770-45f4-b9e9-b31844b8704a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028770 Jun 29 08:40:44.930610 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 273/575] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:47.261645 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1c2edaeb-184b-4f32-8524-e4ab052fd1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: .version_select at 0x7fade41cdf70>, body: {"keypair": {"name": "tempest-keypair-1188896370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbI/UtI4DEipF9a/rq5v2HAq/Ziwjl/znoqyYyZUzE1do1culS5ks2KT+BNO8048ggDpY0O05oRz9bg3va4Mty1Otl8MOGjsIgb38aJVTVrScuvwP5VMegMhdibTQfYgw=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:47.278650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-1c2edaeb-184b-4f32-8524-e4ab052fd1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:40:47.283609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-1c2edaeb-184b-4f32-8524-e4ab052fd1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for user bccf002d9da34d1dad0ee71b5b7bb1c1 and project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:40:47.312051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1c2edaeb-184b-4f32-8524-e4ab052fd1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054337 Jun 29 08:40:47.312667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 303/576] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:40:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:47.972857 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-32e153b6-1a8e-43b8-835a-47821edf5d22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:47.973622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-32e153b6-1a8e-43b8-835a-47821edf5d22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:47.979914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32e153b6-1a8e-43b8-835a-47821edf5d22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:47.980359 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32e153b6-1a8e-43b8-835a-47821edf5d22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:47.981122 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32e153b6-1a8e-43b8-835a-47821edf5d22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:47.981552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-32e153b6-1a8e-43b8-835a-47821edf5d22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:48.007606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-32e153b6-1a8e-43b8-835a-47821edf5d22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:40:48.099882 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-32e153b6-1a8e-43b8-835a-47821edf5d22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 204 len: 0 microversion: 2.1 time: 0.132654 Jun 29 08:40:48.100780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 274/577] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:40:47 2022] DELETE /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:40:48.109024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3048ae4e-fbb9-4325-a0af-f597ca43f309 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:48.109924 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3048ae4e-fbb9-4325-a0af-f597ca43f309 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:48.116045 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3048ae4e-fbb9-4325-a0af-f597ca43f309 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:48.116486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3048ae4e-fbb9-4325-a0af-f597ca43f309 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:48.117236 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3048ae4e-fbb9-4325-a0af-f597ca43f309 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:48.117678 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3048ae4e-fbb9-4325-a0af-f597ca43f309 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:48.318600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3048ae4e-fbb9-4325-a0af-f597ca43f309 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:48.326198 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3048ae4e-fbb9-4325-a0af-f597ca43f309 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1514 microversion: 2.1 time: 0.221312 Jun 29 08:40:48.326791 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 304/578] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:48 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:48.658303 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-487023444", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fbe4e8a-ed08-40e1-b1bc-8913ebef6d94"}], "security_groups": [{"name": "tempest-securitygroup--1432551204"}], "key_name": "tempest-keypair-1188896370", "user_data": "}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:48.769036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] validate_networks() for [('7fbe4e8a-ed08-40e1-b1bc-8913ebef6d94', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:40:49.223736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:40:49.224357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:40:49.224619 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:40:49.225019 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:40:49.225425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:40:49.235868 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:49.236306 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:49.237093 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:49.237516 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:49.256260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:40:49.260753 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for user bccf002d9da34d1dad0ee71b5b7bb1c1 and project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:40:49.272966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:40:49.275311 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:40:49.330144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-11166c1a-6e0f-4e36-a830-3feb6ef6f21a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.677092 Jun 29 08:40:49.331000 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 275/579] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:40:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:40:49.341635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1c52c378-ecb9-46fc-a841-dc745f7cbf93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:49.342443 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1c52c378-ecb9-46fc-a841-dc745f7cbf93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:49.343430 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-184e29a7-f7f5-4af6-94c1-f4fe29201b08 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:49.344320 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-184e29a7-f7f5-4af6-94c1-f4fe29201b08 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:49.350561 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-184e29a7-f7f5-4af6-94c1-f4fe29201b08 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:49.351452 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-184e29a7-f7f5-4af6-94c1-f4fe29201b08 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:49.351771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-184e29a7-f7f5-4af6-94c1-f4fe29201b08 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:49.352197 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-184e29a7-f7f5-4af6-94c1-f4fe29201b08 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:49.403860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1c52c378-ecb9-46fc-a841-dc745f7cbf93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:49.411261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1c52c378-ecb9-46fc-a841-dc745f7cbf93 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1241 microversion: 2.1 time: 0.073720 Jun 29 08:40:49.411837 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 305/580] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:49 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:49.505766 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-184e29a7-f7f5-4af6-94c1-f4fe29201b08 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:49.514824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-184e29a7-f7f5-4af6-94c1-f4fe29201b08 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1514 microversion: 2.1 time: 0.175054 Jun 29 08:40:49.515601 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 276/581] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:49 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:40:50.429099 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7326e5e3-17af-4726-b3b9-03d7c140c624 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:50.429694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7326e5e3-17af-4726-b3b9-03d7c140c624 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:50.437814 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7326e5e3-17af-4726-b3b9-03d7c140c624 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:50.438253 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7326e5e3-17af-4726-b3b9-03d7c140c624 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:50.439310 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7326e5e3-17af-4726-b3b9-03d7c140c624 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:50.439744 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7326e5e3-17af-4726-b3b9-03d7c140c624 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:50.512261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7326e5e3-17af-4726-b3b9-03d7c140c624 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:50.520736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7326e5e3-17af-4726-b3b9-03d7c140c624 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1293 microversion: 2.1 time: 0.095571 Jun 29 08:40:50.521318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 306/582] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:50 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:50.538012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a552260b-60e4-425d-afa6-fd6e28159ff0 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:50.539398 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a552260b-60e4-425d-afa6-fd6e28159ff0 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:50.546671 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a552260b-60e4-425d-afa6-fd6e28159ff0 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:50.547348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a552260b-60e4-425d-afa6-fd6e28159ff0 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:50.548733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a552260b-60e4-425d-afa6-fd6e28159ff0 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:50.549486 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a552260b-60e4-425d-afa6-fd6e28159ff0 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:50.698001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a552260b-60e4-425d-afa6-fd6e28159ff0 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:50.705990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a552260b-60e4-425d-afa6-fd6e28159ff0 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1514 microversion: 2.1 time: 0.172525 Jun 29 08:40:50.706552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 277/583] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:50 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:51.301436 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-1db5cff8-517f-45f3-b9aa-1dee71b8e6f5 req-34d15542-2475-4606-8d0c-fc10b51334cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd35412-acc9-4da0-8b0b-be5ce54315de", "name": "network-vif-deleted", "tag": "73addd5f-6f81-4593-9ca8-8245c59b15e3"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:51.309830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-1db5cff8-517f-45f3-b9aa-1dee71b8e6f5 req-34d15542-2475-4606-8d0c-fc10b51334cc service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:51.310276 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-1db5cff8-517f-45f3-b9aa-1dee71b8e6f5 req-34d15542-2475-4606-8d0c-fc10b51334cc service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:51.321284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-1db5cff8-517f-45f3-b9aa-1dee71b8e6f5 req-34d15542-2475-4606-8d0c-fc10b51334cc service nova] Creating event network-vif-deleted:73addd5f-6f81-4593-9ca8-8245c59b15e3 for instance 8fd35412-acc9-4da0-8b0b-be5ce54315de on hv-cinder-79760 Jun 29 08:40:51.326291 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-1db5cff8-517f-45f3-b9aa-1dee71b8e6f5 req-34d15542-2475-4606-8d0c-fc10b51334cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028756 Jun 29 08:40:51.326897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 307/584] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:51.538190 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-065adb37-8049-4aee-a698-92eb5b62e46f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:51.538832 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-065adb37-8049-4aee-a698-92eb5b62e46f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:51.545085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-065adb37-8049-4aee-a698-92eb5b62e46f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:51.545526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-065adb37-8049-4aee-a698-92eb5b62e46f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:51.546284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-065adb37-8049-4aee-a698-92eb5b62e46f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:51.546732 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-065adb37-8049-4aee-a698-92eb5b62e46f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:51.610676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-065adb37-8049-4aee-a698-92eb5b62e46f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:51.618990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-065adb37-8049-4aee-a698-92eb5b62e46f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1299 microversion: 2.1 time: 0.084445 Jun 29 08:40:51.619811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 278/585] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:51 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:51.725323 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:51.725896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:51.732859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:51.733296 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:51.734256 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:51.734827 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:51.769367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:51.770105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:51.770586 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lazy-loading 'fault' on Instance uuid 8fd35412-acc9-4da0-8b0b-be5ce54315de {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:40:51.817640 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:51.826262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1e5fda05-3d13-40f4-a093-68b755874d15 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 200 len: 1309 microversion: 2.1 time: 0.106224 Jun 29 08:40:51.826841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 308/586] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:51 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:52.637151 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6362d6cd-3955-45a5-b843-b0226ee0fea8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:52.637765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6362d6cd-3955-45a5-b843-b0226ee0fea8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:52.655820 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6362d6cd-3955-45a5-b843-b0226ee0fea8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:52.656685 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6362d6cd-3955-45a5-b843-b0226ee0fea8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:52.659444 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6362d6cd-3955-45a5-b843-b0226ee0fea8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:52.660120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6362d6cd-3955-45a5-b843-b0226ee0fea8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:52.718207 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-fa2095d9-ed73-4ec4-803e-28313d1eca24 req-bc75508f-c135-452b-9500-b0c4f07d3f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd027a5-b0e0-4883-a88f-a55e9fdb57f0", "tag": "e98372bd-530d-490d-bea4-fdd0f9209c46"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:40:52.729801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-fa2095d9-ed73-4ec4-803e-28313d1eca24 req-bc75508f-c135-452b-9500-b0c4f07d3f73 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:52.730482 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-fa2095d9-ed73-4ec4-803e-28313d1eca24 req-bc75508f-c135-452b-9500-b0c4f07d3f73 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:52.742953 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-fa2095d9-ed73-4ec4-803e-28313d1eca24 req-bc75508f-c135-452b-9500-b0c4f07d3f73 service nova] Creating event network-changed:e98372bd-530d-490d-bea4-fdd0f9209c46 for instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 on hv-cinder-79760 Jun 29 08:40:52.749284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-fa2095d9-ed73-4ec4-803e-28313d1eca24 req-bc75508f-c135-452b-9500-b0c4f07d3f73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114338 Jun 29 08:40:52.750423 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 309/587] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:40:52.803422 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6362d6cd-3955-45a5-b843-b0226ee0fea8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:52.811409 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6362d6cd-3955-45a5-b843-b0226ee0fea8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.178699 Jun 29 08:40:52.820832 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 279/588] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:52 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:52.844805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:52.845581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 8fd35412-acc9-4da0-8b0b-be5ce54315de] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:52.852097 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:52.852538 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:52.853351 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:52.853785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:52.867517 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] HTTP exception thrown: Instance 8fd35412-acc9-4da0-8b0b-be5ce54315de could not be found. Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Request method failure captured: Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de HTTP/1.1 Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA-hhKnZ5b7Aiy2z4asGcty1hLsn1_yoWIvrVTSoLCjP0Goa5eUSBw00eJbfOWvAw9QdHsk-wYtlg4HZ34fsF_PkmCBTw5_rMJ9rkShoutKmbxbrkl5yV48bG_IGYsMnzo3G9hn7WJOIfATBq3vcSM4Vf5iTuUSNvQabI5PK50mkxcg Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: d1cc844419c14acd9a9e7dfb4233841d Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1832244675 Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:40:52.869141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1cc844419c14acd9a9e7dfb4233841d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1cc844419c14acd9a9e7dfb4233841d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1cc844419c14acd9a9e7dfb4233841d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1cc844419c14acd9a9e7dfb4233841d"}]}] Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesSnapshotTestJSON-1832244675 Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: d1cc844419c14acd9a9e7dfb4233841d Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1832244675 Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesSnapshotTestJSON-1832244675-project Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: e3be3323efb945f1ad6537bbc9eba7b0 Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesSnapshotTestJSON-1832244675-project Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 8fd35412-acc9-4da0-8b0b-be5ce54315de could not be found. Jun 29 08:40:52.870779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '8fd35412-acc9-4da0-8b0b-be5ce54315de'} Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd35412-acc9-4da0-8b0b-be5ce54315de could not be found. Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:40:52.871581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd35412-acc9-4da0-8b0b-be5ce54315de could not be found. Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd35412-acc9-4da0-8b0b-be5ce54315de could not be found. Jun 29 08:40:52.872819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:40:52.873894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Returning 404 to user: Instance 8fd35412-acc9-4da0-8b0b-be5ce54315de could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:40:52.873894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b5fe60b4-5219-41da-85e3-5f9164269a01 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de" status: 404 len: 111 microversion: 2.1 time: 0.030485 Jun 29 08:40:52.873894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 310/589] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:52 2022] GET /compute/v2.1/servers/8fd35412-acc9-4da0-8b0b-be5ce54315de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:40:53.831954 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-16cc85f7-2682-4559-bedb-7251d157a1d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:53.832835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-16cc85f7-2682-4559-bedb-7251d157a1d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:53.842495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-16cc85f7-2682-4559-bedb-7251d157a1d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:53.843156 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-16cc85f7-2682-4559-bedb-7251d157a1d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:53.844219 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-16cc85f7-2682-4559-bedb-7251d157a1d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:53.844932 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-16cc85f7-2682-4559-bedb-7251d157a1d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:53.995298 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-16cc85f7-2682-4559-bedb-7251d157a1d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:54.003149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-16cc85f7-2682-4559-bedb-7251d157a1d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.177268 Jun 29 08:40:54.003677 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 280/590] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:53 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:55.020582 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fd24dff6-909d-466d-ad25-f5154541284b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:55.021145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fd24dff6-909d-466d-ad25-f5154541284b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:55.028421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fd24dff6-909d-466d-ad25-f5154541284b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:55.028871 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fd24dff6-909d-466d-ad25-f5154541284b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:55.029664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fd24dff6-909d-466d-ad25-f5154541284b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:55.030091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fd24dff6-909d-466d-ad25-f5154541284b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:55.168889 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fd24dff6-909d-466d-ad25-f5154541284b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:55.180206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fd24dff6-909d-466d-ad25-f5154541284b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.163565 Jun 29 08:40:55.181056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 311/591] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:55 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:56.199811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0f532511-05e3-4958-acc0-50c73b3c247a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:56.200388 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0f532511-05e3-4958-acc0-50c73b3c247a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:56.207665 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0f532511-05e3-4958-acc0-50c73b3c247a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:56.208110 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0f532511-05e3-4958-acc0-50c73b3c247a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:56.208850 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0f532511-05e3-4958-acc0-50c73b3c247a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:56.209272 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0f532511-05e3-4958-acc0-50c73b3c247a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:56.596629 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0f532511-05e3-4958-acc0-50c73b3c247a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:56.607927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0f532511-05e3-4958-acc0-50c73b3c247a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.411642 Jun 29 08:40:56.608577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 281/592] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:56 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:57.629198 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9b6ec8e0-b77f-4bd5-9094-f5a4e35abc3f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:57.629973 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9b6ec8e0-b77f-4bd5-9094-f5a4e35abc3f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:57.639105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9b6ec8e0-b77f-4bd5-9094-f5a4e35abc3f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:57.639695 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9b6ec8e0-b77f-4bd5-9094-f5a4e35abc3f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:57.640698 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9b6ec8e0-b77f-4bd5-9094-f5a4e35abc3f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:57.641272 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9b6ec8e0-b77f-4bd5-9094-f5a4e35abc3f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:57.791690 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9b6ec8e0-b77f-4bd5-9094-f5a4e35abc3f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:57.801065 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9b6ec8e0-b77f-4bd5-9094-f5a4e35abc3f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.178119 Jun 29 08:40:57.801763 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 312/593] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:57 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:40:58.818412 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-927a5e1f-001e-4593-8430-51449e8562d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:40:58.819045 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-927a5e1f-001e-4593-8430-51449e8562d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:40:58.826494 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-927a5e1f-001e-4593-8430-51449e8562d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:58.826968 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-927a5e1f-001e-4593-8430-51449e8562d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:58.827769 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-927a5e1f-001e-4593-8430-51449e8562d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:40:58.828238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-927a5e1f-001e-4593-8430-51449e8562d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:40:58.977529 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-927a5e1f-001e-4593-8430-51449e8562d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:40:58.985312 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-927a5e1f-001e-4593-8430-51449e8562d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.171323 Jun 29 08:40:58.985892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 282/594] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:58 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:00.006017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ff061e49-d588-4973-8cb1-595f269d5196 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:00.006870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ff061e49-d588-4973-8cb1-595f269d5196 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:00.010734 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:00.018931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff061e49-d588-4973-8cb1-595f269d5196 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:00.019365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff061e49-d588-4973-8cb1-595f269d5196 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:00.020314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff061e49-d588-4973-8cb1-595f269d5196 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:00.020730 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff061e49-d588-4973-8cb1-595f269d5196 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:00.163279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ff061e49-d588-4973-8cb1-595f269d5196 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:00.171392 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ff061e49-d588-4973-8cb1-595f269d5196 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.172456 Jun 29 08:41:00.171951 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 313/595] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:40:59 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:01.192078 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-391a50d7-2897-4ce4-8d82-3ee4fb7f68d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:01.192794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-391a50d7-2897-4ce4-8d82-3ee4fb7f68d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:01.195782 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:01.196007 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:01.203513 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-391a50d7-2897-4ce4-8d82-3ee4fb7f68d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:01.204057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-391a50d7-2897-4ce4-8d82-3ee4fb7f68d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:01.204993 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-391a50d7-2897-4ce4-8d82-3ee4fb7f68d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:01.205512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-391a50d7-2897-4ce4-8d82-3ee4fb7f68d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:01.339807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-391a50d7-2897-4ce4-8d82-3ee4fb7f68d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:01.348531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-391a50d7-2897-4ce4-8d82-3ee4fb7f68d7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.162353 Jun 29 08:41:01.349100 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 283/596] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:01 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:01.645155 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-31658871-d13f-43ed-9ae1-87bc1fceb049 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:01.645733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-31658871-d13f-43ed-9ae1-87bc1fceb049 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:01.652585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-31658871-d13f-43ed-9ae1-87bc1fceb049 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:01.653020 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-31658871-d13f-43ed-9ae1-87bc1fceb049 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:01.653784 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-31658871-d13f-43ed-9ae1-87bc1fceb049 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:01.654209 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-31658871-d13f-43ed-9ae1-87bc1fceb049 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:01.677722 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-31658871-d13f-43ed-9ae1-87bc1fceb049 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/ips" status: 200 len: 152 microversion: 2.20 time: 0.037943 Jun 29 08:41:01.678312 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 314/597] 10.222.0.27 () {60 vars in 1288 bytes} [Wed Jun 29 08:41:01 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:41:02.367960 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a2641b49-6547-41b7-bd00-f365dcc27450 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:02.368886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a2641b49-6547-41b7-bd00-f365dcc27450 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:02.379539 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2641b49-6547-41b7-bd00-f365dcc27450 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:02.380236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2641b49-6547-41b7-bd00-f365dcc27450 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:02.381413 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2641b49-6547-41b7-bd00-f365dcc27450 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:02.382068 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2641b49-6547-41b7-bd00-f365dcc27450 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:02.528523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a2641b49-6547-41b7-bd00-f365dcc27450 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:02.536654 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a2641b49-6547-41b7-bd00-f365dcc27450 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.174714 Jun 29 08:41:02.537220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 284/598] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:02 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:03.557768 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6223f4d1-bd8b-42e3-be55-109398057d51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:03.558958 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6223f4d1-bd8b-42e3-be55-109398057d51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:03.568072 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6223f4d1-bd8b-42e3-be55-109398057d51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:03.568514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6223f4d1-bd8b-42e3-be55-109398057d51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:03.569271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6223f4d1-bd8b-42e3-be55-109398057d51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:03.569693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6223f4d1-bd8b-42e3-be55-109398057d51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:03.704522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6223f4d1-bd8b-42e3-be55-109398057d51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:03.712603 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6223f4d1-bd8b-42e3-be55-109398057d51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.161246 Jun 29 08:41:03.713145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 315/599] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:03 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:04.734496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a839ccba-b5d5-4ebc-8605-058e34607888 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:04.735552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a839ccba-b5d5-4ebc-8605-058e34607888 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:04.742823 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a839ccba-b5d5-4ebc-8605-058e34607888 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:04.743261 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a839ccba-b5d5-4ebc-8605-058e34607888 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:04.744016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a839ccba-b5d5-4ebc-8605-058e34607888 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:04.744439 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a839ccba-b5d5-4ebc-8605-058e34607888 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:04.884145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a839ccba-b5d5-4ebc-8605-058e34607888 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:04.891783 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a839ccba-b5d5-4ebc-8605-058e34607888 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.163676 Jun 29 08:41:04.892351 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 285/600] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:04 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:04.907098 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1537839362", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "networks": [{"uuid": "8b77b65e-aef4-46b9-8d10-e3ad890c8f41"}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:04.958346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] validate_networks() for [('8b77b65e-aef4-46b9-8d10-e3ad890c8f41', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:41:05.395336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:41:05.395752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:41:05.396222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:41:05.396624 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:41:05.397025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:41:05.406804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:05.407242 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:05.408033 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:05.408459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:05.426414 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Getting quotas for project d1cc844419c14acd9a9e7dfb4233841d. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:41:05.430627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Getting quotas for user e3be3323efb945f1ad6537bbc9eba7b0 and project d1cc844419c14acd9a9e7dfb4233841d. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:41:05.441919 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:41:05.444214 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:41:05.493223 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-10d9c8f4-6030-47a7-aa3f-c5f4fe270cfb tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590046 Jun 29 08:41:05.493875 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 316/601] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:41:05.504010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-57b57ac5-050c-4ade-83ca-c4fabd119630 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:05.504625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-57b57ac5-050c-4ade-83ca-c4fabd119630 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:05.559168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-57b57ac5-050c-4ade-83ca-c4fabd119630 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:05.566557 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-57b57ac5-050c-4ade-83ca-c4fabd119630 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1219 microversion: 2.1 time: 0.066238 Jun 29 08:41:05.567180 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 286/602] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:05 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:05.909683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d3952ec9-8c96-4aaf-b7e4-71f2dd318054 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:05.910238 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d3952ec9-8c96-4aaf-b7e4-71f2dd318054 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:05.917017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3952ec9-8c96-4aaf-b7e4-71f2dd318054 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:05.917442 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3952ec9-8c96-4aaf-b7e4-71f2dd318054 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:05.918194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3952ec9-8c96-4aaf-b7e4-71f2dd318054 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:05.918621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3952ec9-8c96-4aaf-b7e4-71f2dd318054 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:06.055042 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d3952ec9-8c96-4aaf-b7e4-71f2dd318054 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:06.062554 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d3952ec9-8c96-4aaf-b7e4-71f2dd318054 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.157030 Jun 29 08:41:06.063143 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 317/603] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:05 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:06.586805 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-72bc78cb-ead5-4dcb-8fa7-d75cb37148b1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:06.588021 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-72bc78cb-ead5-4dcb-8fa7-d75cb37148b1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:06.599763 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72bc78cb-ead5-4dcb-8fa7-d75cb37148b1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:06.600201 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72bc78cb-ead5-4dcb-8fa7-d75cb37148b1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:06.601061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72bc78cb-ead5-4dcb-8fa7-d75cb37148b1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:06.601709 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-72bc78cb-ead5-4dcb-8fa7-d75cb37148b1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:06.668240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-72bc78cb-ead5-4dcb-8fa7-d75cb37148b1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:06.670404 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:06.677119 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-72bc78cb-ead5-4dcb-8fa7-d75cb37148b1 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1271 microversion: 2.1 time: 0.096565 Jun 29 08:41:06.677610 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 287/604] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:06 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:06.933475 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0fd5504a-f679-4ad4-af11-fc8198aa08b1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:06.934880 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0fd5504a-f679-4ad4-af11-fc8198aa08b1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:06.941505 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0fd5504a-f679-4ad4-af11-fc8198aa08b1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:06.942248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0fd5504a-f679-4ad4-af11-fc8198aa08b1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:06.943041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0fd5504a-f679-4ad4-af11-fc8198aa08b1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:06.943452 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0fd5504a-f679-4ad4-af11-fc8198aa08b1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:06.966787 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-0fd5504a-f679-4ad4-af11-fc8198aa08b1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lazy-loading 'flavor' on Instance uuid dcdb4aec-5168-4f28-b336-45afe2620e64 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:41:06.986626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:07.080302 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7dc801f9-2ede-478c-a5fe-f16319830008 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:07.081222 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7dc801f9-2ede-478c-a5fe-f16319830008 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:07.088650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7dc801f9-2ede-478c-a5fe-f16319830008 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:07.089259 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7dc801f9-2ede-478c-a5fe-f16319830008 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:07.090534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7dc801f9-2ede-478c-a5fe-f16319830008 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:07.091228 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7dc801f9-2ede-478c-a5fe-f16319830008 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:07.242403 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0fd5504a-f679-4ad4-af11-fc8198aa08b1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/action" status: 202 len: 0 microversion: 2.20 time: 0.312833 Jun 29 08:41:07.247174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 318/605] 10.222.0.27 () {62 vars in 1318 bytes} [Wed Jun 29 08:41:06 2022] POST /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:41:07.255006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:07.255703 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:07.262679 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:07.263160 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:07.264040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:07.264476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:07.412054 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7dc801f9-2ede-478c-a5fe-f16319830008 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:07.423519 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7dc801f9-2ede-478c-a5fe-f16319830008 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.347824 Jun 29 08:41:07.424096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 288/606] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:07 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:41:07.532793 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:07.542326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:07.543857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:07.545039 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9a765adc-a4ad-452a-859f-39906d7dcaf5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.294995 Jun 29 08:41:07.545592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 319/607] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:07 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:41:07.694735 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-441b9d26-998f-4325-add4-f423495ddd67 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:07.695629 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-441b9d26-998f-4325-add4-f423495ddd67 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:07.702540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-441b9d26-998f-4325-add4-f423495ddd67 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:07.703040 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-441b9d26-998f-4325-add4-f423495ddd67 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:07.703852 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-441b9d26-998f-4325-add4-f423495ddd67 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:07.704338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-441b9d26-998f-4325-add4-f423495ddd67 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:07.921734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-441b9d26-998f-4325-add4-f423495ddd67 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:07.932086 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-441b9d26-998f-4325-add4-f423495ddd67 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.241631 Jun 29 08:41:07.932894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-d0799e13-9044-42c7-bded-2e22c2b92a61 req-5ffe9a4f-c32a-437b-a2b0-6b7d32426299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd027a5-b0e0-4883-a88f-a55e9fdb57f0", "name": "network-vif-plugged", "status": "completed", "tag": "e98372bd-530d-490d-bea4-fdd0f9209c46"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:07.943698 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 289/608] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:07 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:07.950402 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-d0799e13-9044-42c7-bded-2e22c2b92a61 req-5ffe9a4f-c32a-437b-a2b0-6b7d32426299 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:07.952203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-d0799e13-9044-42c7-bded-2e22c2b92a61 req-5ffe9a4f-c32a-437b-a2b0-6b7d32426299 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:07.964801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-d0799e13-9044-42c7-bded-2e22c2b92a61 req-5ffe9a4f-c32a-437b-a2b0-6b7d32426299 service nova] Creating event network-vif-plugged:e98372bd-530d-490d-bea4-fdd0f9209c46 for instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 on hv-cinder-79760 Jun 29 08:41:07.970835 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-d0799e13-9044-42c7-bded-2e22c2b92a61 req-5ffe9a4f-c32a-437b-a2b0-6b7d32426299 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046668 Jun 29 08:41:07.971511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 320/609] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:08.440450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-97232b34-59b5-473d-bbe0-4fb2b17a673f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:08.441061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-97232b34-59b5-473d-bbe0-4fb2b17a673f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:08.448001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97232b34-59b5-473d-bbe0-4fb2b17a673f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:08.448441 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97232b34-59b5-473d-bbe0-4fb2b17a673f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:08.449413 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97232b34-59b5-473d-bbe0-4fb2b17a673f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:08.450131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97232b34-59b5-473d-bbe0-4fb2b17a673f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:08.566382 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:08.567186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:08.574506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:08.574972 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:08.575799 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:08.576222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:08.708857 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-97232b34-59b5-473d-bbe0-4fb2b17a673f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:08.718254 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-97232b34-59b5-473d-bbe0-4fb2b17a673f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.281398 Jun 29 08:41:08.719144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 290/610] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:08 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:08.773236 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:08.781655 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:08.783452 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:08.784503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-182f850b-c2b5-4a46-9512-acec94d566c5 req-d12cdd33-4d2c-4553-8d05-f97605c7caf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d081293-96bb-4377-b429-dea8a3d06c68", "tag": "c205761a-b8ec-4a08-8a24-bae2b9c03871"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:08.784662 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-25f45ee8-7d66-47db-862f-11ed39e36edd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.222904 Jun 29 08:41:08.794109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-182f850b-c2b5-4a46-9512-acec94d566c5 req-d12cdd33-4d2c-4553-8d05-f97605c7caf3 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:08.794567 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-182f850b-c2b5-4a46-9512-acec94d566c5 req-d12cdd33-4d2c-4553-8d05-f97605c7caf3 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:08.795620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 321/611] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:08 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:08.806723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-182f850b-c2b5-4a46-9512-acec94d566c5 req-d12cdd33-4d2c-4553-8d05-f97605c7caf3 service nova] Creating event network-changed:c205761a-b8ec-4a08-8a24-bae2b9c03871 for instance 7d081293-96bb-4377-b429-dea8a3d06c68 on hv-cinder-79760 Jun 29 08:41:08.811990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-182f850b-c2b5-4a46-9512-acec94d566c5 req-d12cdd33-4d2c-4553-8d05-f97605c7caf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091507 Jun 29 08:41:08.812559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 291/612] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:08.956346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-eadf432f-caa9-4446-a5c4-a788e7d36fb6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:08.956949 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-eadf432f-caa9-4446-a5c4-a788e7d36fb6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:08.963921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eadf432f-caa9-4446-a5c4-a788e7d36fb6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:08.964333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eadf432f-caa9-4446-a5c4-a788e7d36fb6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:08.965440 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eadf432f-caa9-4446-a5c4-a788e7d36fb6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:08.965838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eadf432f-caa9-4446-a5c4-a788e7d36fb6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:09.099097 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-eadf432f-caa9-4446-a5c4-a788e7d36fb6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:09.107360 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-eadf432f-caa9-4446-a5c4-a788e7d36fb6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.157516 Jun 29 08:41:09.107918 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 322/613] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:08 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:09.740187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a5ca2b9c-8bf0-4075-b188-fe2ff9a7cf13 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:09.740779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a5ca2b9c-8bf0-4075-b188-fe2ff9a7cf13 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:09.748016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a5ca2b9c-8bf0-4075-b188-fe2ff9a7cf13 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:09.748457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a5ca2b9c-8bf0-4075-b188-fe2ff9a7cf13 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:09.749243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a5ca2b9c-8bf0-4075-b188-fe2ff9a7cf13 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:09.749670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a5ca2b9c-8bf0-4075-b188-fe2ff9a7cf13 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:09.803542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:09.804254 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:09.806334 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:09.811833 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:09.812271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:09.813229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:09.813439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:09.924942 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a5ca2b9c-8bf0-4075-b188-fe2ff9a7cf13 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:09.933402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a5ca2b9c-8bf0-4075-b188-fe2ff9a7cf13 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1367 microversion: 2.1 time: 0.199502 Jun 29 08:41:09.934051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 292/614] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:09 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:09.971858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:09.980528 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:09.982068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:09.983268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-da4bd7f5-d9c1-47d6-b343-c70a3098086a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.183837 Jun 29 08:41:09.983820 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 323/615] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:09 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:10.126947 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a23de3ad-8e5e-43eb-8c60-2e61723dc2b6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:10.127747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a23de3ad-8e5e-43eb-8c60-2e61723dc2b6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:10.134360 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a23de3ad-8e5e-43eb-8c60-2e61723dc2b6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:10.134792 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a23de3ad-8e5e-43eb-8c60-2e61723dc2b6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:10.135578 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a23de3ad-8e5e-43eb-8c60-2e61723dc2b6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:10.135995 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a23de3ad-8e5e-43eb-8c60-2e61723dc2b6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:10.327978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a23de3ad-8e5e-43eb-8c60-2e61723dc2b6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:10.335508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a23de3ad-8e5e-43eb-8c60-2e61723dc2b6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.214815 Jun 29 08:41:10.336071 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 293/616] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:10 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:10.953774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d4b7718e-9016-41c7-af71-ea7840647b55 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:10.954630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d4b7718e-9016-41c7-af71-ea7840647b55 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:10.965973 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4b7718e-9016-41c7-af71-ea7840647b55 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:10.966744 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4b7718e-9016-41c7-af71-ea7840647b55 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:10.968011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4b7718e-9016-41c7-af71-ea7840647b55 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:10.968767 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4b7718e-9016-41c7-af71-ea7840647b55 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:11.003834 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:11.004905 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:11.011940 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:11.012383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:11.013152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:11.013585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:11.152901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4b7718e-9016-41c7-af71-ea7840647b55 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:11.161050 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d4b7718e-9016-41c7-af71-ea7840647b55 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1557 microversion: 2.1 time: 0.213927 Jun 29 08:41:11.161592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 324/617] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:10 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:11.177889 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9cd79e7a-9b43-488e-a615-19d7385573e5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:11.178389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9cd79e7a-9b43-488e-a615-19d7385573e5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:11.182892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:11.186160 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9cd79e7a-9b43-488e-a615-19d7385573e5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:11.186630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9cd79e7a-9b43-488e-a615-19d7385573e5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:11.187490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9cd79e7a-9b43-488e-a615-19d7385573e5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:11.187937 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9cd79e7a-9b43-488e-a615-19d7385573e5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:11.193280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:11.194961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:11.196209 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-77eb5870-3cd2-46ee-a384-62a85328bc40 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.197356 Jun 29 08:41:11.207926 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 294/618] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:10 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:11.292278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9cd79e7a-9b43-488e-a615-19d7385573e5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118785 Jun 29 08:41:11.292876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 325/619] 10.222.0.27 () {58 vars in 1274 bytes} [Wed Jun 29 08:41:11 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:11.353516 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c7bd38bf-887d-49c1-9578-3433d2a73987 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:11.354448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c7bd38bf-887d-49c1-9578-3433d2a73987 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:11.356916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:11.363183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c7bd38bf-887d-49c1-9578-3433d2a73987 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:11.363749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c7bd38bf-887d-49c1-9578-3433d2a73987 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:11.364715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c7bd38bf-887d-49c1-9578-3433d2a73987 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:11.365149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c7bd38bf-887d-49c1-9578-3433d2a73987 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:11.587068 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c7bd38bf-887d-49c1-9578-3433d2a73987 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:11.596031 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c7bd38bf-887d-49c1-9578-3433d2a73987 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.246447 Jun 29 08:41:11.596591 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 295/620] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:11 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:12.217350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:12.217939 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:12.224861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:12.225305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:12.226069 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:12.226501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:12.364805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:12.372838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:12.374341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:12.375520 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6db771fc-3075-4369-9cc5-fb6602b85b8c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.163041 Jun 29 08:41:12.376051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 326/621] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:12 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:12.456885 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-4dfc8cca-0f5d-4df6-b6da-5230dcfe0801 req-12bc6a34-1b89-419d-8ec3-849e30a975b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd027a5-b0e0-4883-a88f-a55e9fdb57f0", "tag": "e98372bd-530d-490d-bea4-fdd0f9209c46"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:12.467099 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-4dfc8cca-0f5d-4df6-b6da-5230dcfe0801 req-12bc6a34-1b89-419d-8ec3-849e30a975b4 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:12.467425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-4dfc8cca-0f5d-4df6-b6da-5230dcfe0801 req-12bc6a34-1b89-419d-8ec3-849e30a975b4 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:12.479183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-4dfc8cca-0f5d-4df6-b6da-5230dcfe0801 req-12bc6a34-1b89-419d-8ec3-849e30a975b4 service nova] Creating event network-changed:e98372bd-530d-490d-bea4-fdd0f9209c46 for instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 on hv-cinder-79760 Jun 29 08:41:12.484007 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-4dfc8cca-0f5d-4df6-b6da-5230dcfe0801 req-12bc6a34-1b89-419d-8ec3-849e30a975b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031307 Jun 29 08:41:12.484596 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 296/622] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:12.613506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-349c45b3-90e3-4e55-9a28-1538c2084e7a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:12.614285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-349c45b3-90e3-4e55-9a28-1538c2084e7a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:12.620486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-349c45b3-90e3-4e55-9a28-1538c2084e7a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:12.620948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-349c45b3-90e3-4e55-9a28-1538c2084e7a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:12.621716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-349c45b3-90e3-4e55-9a28-1538c2084e7a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:12.622145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-349c45b3-90e3-4e55-9a28-1538c2084e7a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:12.761207 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-349c45b3-90e3-4e55-9a28-1538c2084e7a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:12.768841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-349c45b3-90e3-4e55-9a28-1538c2084e7a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.159326 Jun 29 08:41:12.769726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 327/623] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:12 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:13.394343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:13.395070 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:13.401883 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:13.402345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:13.403184 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:13.403605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:13.536005 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:13.544052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:13.545523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:13.546724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-62c96af0-f494-4f99-811e-2162e5687603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.156822 Jun 29 08:41:13.547253 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 297/624] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:13 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:13.786045 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2984944e-9264-4d41-9a46-d6bd23aebd22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:13.786596 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2984944e-9264-4d41-9a46-d6bd23aebd22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:13.793588 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2984944e-9264-4d41-9a46-d6bd23aebd22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:13.794037 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2984944e-9264-4d41-9a46-d6bd23aebd22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:13.794842 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2984944e-9264-4d41-9a46-d6bd23aebd22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:13.795271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2984944e-9264-4d41-9a46-d6bd23aebd22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:13.930488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2984944e-9264-4d41-9a46-d6bd23aebd22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:13.938621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2984944e-9264-4d41-9a46-d6bd23aebd22 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.156885 Jun 29 08:41:13.939235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 328/625] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:13 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:14.568769 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:14.569368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:14.577061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:14.577553 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:14.578397 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:14.578916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:14.724195 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:14.732519 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:14.734023 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:14.735253 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-af298be1-eedd-473c-ace0-5635f7013eba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.172445 Jun 29 08:41:14.735820 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 298/626] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:14 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:14.959631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9757efcf-417a-4014-bff3-454f0ef6f977 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:14.960343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9757efcf-417a-4014-bff3-454f0ef6f977 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:14.969139 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9757efcf-417a-4014-bff3-454f0ef6f977 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:14.969691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9757efcf-417a-4014-bff3-454f0ef6f977 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:14.970630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9757efcf-417a-4014-bff3-454f0ef6f977 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:14.971201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9757efcf-417a-4014-bff3-454f0ef6f977 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:15.111756 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9757efcf-417a-4014-bff3-454f0ef6f977 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:15.119766 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9757efcf-417a-4014-bff3-454f0ef6f977 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.166305 Jun 29 08:41:15.120320 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 329/627] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:14 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:15.755200 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:15.755928 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:15.758218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:15.765820 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:15.766358 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:15.767346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:15.767843 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:15.907895 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:15.916987 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:15.918452 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:15.919738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ff6023cd-eece-410a-af8a-ebe3f8148e70 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.169430 Jun 29 08:41:15.920301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 299/628] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:15 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:16.141203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e1326983-51a8-40c8-9633-9a2b1406bf7d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:16.142203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e1326983-51a8-40c8-9633-9a2b1406bf7d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:16.145184 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:16.146304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:16.156220 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1326983-51a8-40c8-9633-9a2b1406bf7d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:16.156956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1326983-51a8-40c8-9633-9a2b1406bf7d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:16.158217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1326983-51a8-40c8-9633-9a2b1406bf7d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:16.158983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1326983-51a8-40c8-9633-9a2b1406bf7d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:16.329717 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e1326983-51a8-40c8-9633-9a2b1406bf7d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:16.337638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e1326983-51a8-40c8-9633-9a2b1406bf7d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.203037 Jun 29 08:41:16.338305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 330/629] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:16 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:16.940471 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:16.941349 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:16.948872 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:16.949275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:16.950063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:16.950484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:17.083978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:17.093289 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:17.094834 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:17.095981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-902b3abe-7914-4a58-bea5-1089485f6eb4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.161982 Jun 29 08:41:17.096546 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 300/630] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:16 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:17.358836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4a81b065-9a52-4510-b3d4-ca63ad5c9003 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:17.359752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4a81b065-9a52-4510-b3d4-ca63ad5c9003 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:17.368580 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a81b065-9a52-4510-b3d4-ca63ad5c9003 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:17.369031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a81b065-9a52-4510-b3d4-ca63ad5c9003 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:17.369787 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a81b065-9a52-4510-b3d4-ca63ad5c9003 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:17.370213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a81b065-9a52-4510-b3d4-ca63ad5c9003 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:17.502279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4a81b065-9a52-4510-b3d4-ca63ad5c9003 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:17.510278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4a81b065-9a52-4510-b3d4-ca63ad5c9003 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.157614 Jun 29 08:41:17.510884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 331/631] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:17 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:18.117350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:18.117945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:18.124890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:18.125332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:18.126078 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:18.126503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:18.265068 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:18.273699 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:18.275216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:18.277088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-41037938-953f-4b3e-8370-86f26f5411d6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.164598 Jun 29 08:41:18.277659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 301/632] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:18 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:18.437920 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-13f55796-3b69-48de-be6b-55f88469f54d req-9684fb48-2944-4d87-9d3d-019178ea4745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d081293-96bb-4377-b429-dea8a3d06c68", "name": "network-vif-plugged", "status": "completed", "tag": "c205761a-b8ec-4a08-8a24-bae2b9c03871"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:18.446636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-13f55796-3b69-48de-be6b-55f88469f54d req-9684fb48-2944-4d87-9d3d-019178ea4745 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:18.447097 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-13f55796-3b69-48de-be6b-55f88469f54d req-9684fb48-2944-4d87-9d3d-019178ea4745 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:18.460115 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-13f55796-3b69-48de-be6b-55f88469f54d req-9684fb48-2944-4d87-9d3d-019178ea4745 service nova] Creating event network-vif-plugged:c205761a-b8ec-4a08-8a24-bae2b9c03871 for instance 7d081293-96bb-4377-b429-dea8a3d06c68 on hv-cinder-79760 Jun 29 08:41:18.465757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-13f55796-3b69-48de-be6b-55f88469f54d req-9684fb48-2944-4d87-9d3d-019178ea4745 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031182 Jun 29 08:41:18.466564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 332/633] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:18.526922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b130c36e-151f-449e-bc88-c34cf927a42f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:18.527508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b130c36e-151f-449e-bc88-c34cf927a42f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:18.533856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b130c36e-151f-449e-bc88-c34cf927a42f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:18.534294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b130c36e-151f-449e-bc88-c34cf927a42f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:18.535081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b130c36e-151f-449e-bc88-c34cf927a42f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:18.535503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b130c36e-151f-449e-bc88-c34cf927a42f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:18.673402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b130c36e-151f-449e-bc88-c34cf927a42f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:18.682799 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b130c36e-151f-449e-bc88-c34cf927a42f tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.159759 Jun 29 08:41:18.683390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 302/634] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:18 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:19.300940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:19.302096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:19.312610 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:19.313333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:19.314567 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:19.315319 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:19.456774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:19.465650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:19.467187 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:19.468322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f7b08053-9007-4d99-bafe-00f3cbd49f24 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.174670 Jun 29 08:41:19.468880 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 333/635] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:19 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:19.704233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5ff4b321-a3df-477f-8f49-36fbfec97259 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:19.705085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5ff4b321-a3df-477f-8f49-36fbfec97259 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:19.716434 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5ff4b321-a3df-477f-8f49-36fbfec97259 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:19.717131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5ff4b321-a3df-477f-8f49-36fbfec97259 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:19.718417 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5ff4b321-a3df-477f-8f49-36fbfec97259 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:19.719134 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5ff4b321-a3df-477f-8f49-36fbfec97259 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:20.100900 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5ff4b321-a3df-477f-8f49-36fbfec97259 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:20.112781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5ff4b321-a3df-477f-8f49-36fbfec97259 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.414889 Jun 29 08:41:20.113540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 303/636] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:19 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:41:20.487087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:20.487680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:20.494927 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:20.495365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:20.496112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:20.496529 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:20.645001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:20.653656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:20.655191 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:20.656355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-be1a128a-aca1-4dbb-91b4-af651024762d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.173278 Jun 29 08:41:20.656920 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 334/637] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:20 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:21.134612 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-22979190-b6ea-410b-938f-95dcd0a3afe6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:21.135650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-22979190-b6ea-410b-938f-95dcd0a3afe6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:21.146919 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22979190-b6ea-410b-938f-95dcd0a3afe6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:21.147680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22979190-b6ea-410b-938f-95dcd0a3afe6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:21.148989 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22979190-b6ea-410b-938f-95dcd0a3afe6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:21.149647 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22979190-b6ea-410b-938f-95dcd0a3afe6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:21.284010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-22979190-b6ea-410b-938f-95dcd0a3afe6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:21.292086 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-22979190-b6ea-410b-938f-95dcd0a3afe6 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1319 microversion: 2.1 time: 0.163863 Jun 29 08:41:21.292629 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 304/638] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:21 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:21.679688 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:21.681039 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:21.687597 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:21.688044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:21.688801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:21.689228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:21.708363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:21.832780 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:21.841979 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:21.843516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:21.844674 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-33063c4e-d4ec-4105-a977-98ef123c8c42 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.171548 Jun 29 08:41:21.845195 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 335/639] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:21 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:22.313645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-22c9bc4c-6533-4cb2-a37e-d0d9b008bebc tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:22.314220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-22c9bc4c-6533-4cb2-a37e-d0d9b008bebc tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:22.321054 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22c9bc4c-6533-4cb2-a37e-d0d9b008bebc tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:22.321493 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22c9bc4c-6533-4cb2-a37e-d0d9b008bebc tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:22.322451 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22c9bc4c-6533-4cb2-a37e-d0d9b008bebc tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:22.322902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22c9bc4c-6533-4cb2-a37e-d0d9b008bebc tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:22.453187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-22c9bc4c-6533-4cb2-a37e-d0d9b008bebc tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:22.455490 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:22.462408 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-22c9bc4c-6533-4cb2-a37e-d0d9b008bebc tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1509 microversion: 2.1 time: 0.152732 Jun 29 08:41:22.463152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 305/640] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:22 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:22.479666 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4547f1ad-8b15-4dd9-8302-273153a2f190 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19a71fed-c29f-49ea-a626-d9d732bc6f05", "device": "/dev/sdb"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:22.480926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4547f1ad-8b15-4dd9-8302-273153a2f190 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:22.487065 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4547f1ad-8b15-4dd9-8302-273153a2f190 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:22.487503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4547f1ad-8b15-4dd9-8302-273153a2f190 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:22.488287 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4547f1ad-8b15-4dd9-8302-273153a2f190 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:22.488708 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4547f1ad-8b15-4dd9-8302-273153a2f190 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:22.775406 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4547f1ad-8b15-4dd9-8302-273153a2f190 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "POST /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299345 Jun 29 08:41:22.776082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 336/641] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:41:22 2022] POST /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:22.864076 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:22.864866 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:22.872106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:22.872572 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:22.873308 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:22.873737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:23.012969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:23.024958 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:23.027109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:23.028892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-914b4fd0-f0da-4838-b7b7-fdaf201f7675 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.168443 Jun 29 08:41:23.029685 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 306/642] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:22 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:41:24.052909 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:24.053480 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:24.060310 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:24.060751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:24.061507 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:24.061926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:24.203896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:24.211959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:24.213748 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:24.214933 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d7fae39b-9cdc-45e1-8091-ab6632531986 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.167108 Jun 29 08:41:24.215830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 337/643] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:24 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:24.366211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-148e56a9-e1fd-4979-9eab-9bca843909dc req-f6089b9a-e059-4002-8c4a-78713da3d7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdb4aec-5168-4f28-b336-45afe2620e64", "name": "network-vif-plugged", "status": "completed", "tag": "4a2b788b-b706-4ae1-a969-16b817f7a8ad"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:24.374393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-148e56a9-e1fd-4979-9eab-9bca843909dc req-f6089b9a-e059-4002-8c4a-78713da3d7fc service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:24.374817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-148e56a9-e1fd-4979-9eab-9bca843909dc req-f6089b9a-e059-4002-8c4a-78713da3d7fc service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:24.386916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-148e56a9-e1fd-4979-9eab-9bca843909dc req-f6089b9a-e059-4002-8c4a-78713da3d7fc service nova] Creating event network-vif-plugged:4a2b788b-b706-4ae1-a969-16b817f7a8ad for instance dcdb4aec-5168-4f28-b336-45afe2620e64 on hv-cinder-79760 Jun 29 08:41:24.392242 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-148e56a9-e1fd-4979-9eab-9bca843909dc req-f6089b9a-e059-4002-8c4a-78713da3d7fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090979 Jun 29 08:41:24.393078 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 307/644] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:25.238097 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:25.239081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:25.250077 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:25.250855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:25.252118 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:25.252856 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:25.391327 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:25.399472 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:25.401188 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:25.402333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3f058663-a5b4-434c-91a2-8ab7fe2033e2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.171110 Jun 29 08:41:25.402913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 338/645] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:25 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:26.426680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:26.427886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:26.439669 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:26.440390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:26.441624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:26.442323 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:26.581773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:26.591310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:26.592811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:26.593972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dee92499-e7d6-4b75-a3f6-0bbfb74a3cf9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.175078 Jun 29 08:41:26.594532 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 308/646] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:26 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:27.616542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:27.617551 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:27.625698 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:27.626142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:27.626933 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:27.627361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:27.774254 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:27.782600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:27.784123 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:27.785266 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3e0087cb-3208-4666-8b43-5cd20f34cb82 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.175384 Jun 29 08:41:27.785829 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 339/647] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:27 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:28.812504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:28.813385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:28.824101 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:28.824534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:28.825288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:28.825708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:28.969698 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:28.978085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:28.979718 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:28.980868 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1a11315a-5998-4ac2-adb7-5823ba5e9e16 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.175524 Jun 29 08:41:28.981418 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 309/648] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:28 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:30.003336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:30.004255 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:30.015425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:30.016160 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:30.017429 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:30.018130 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:30.153609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:30.161715 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:30.163236 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:30.164412 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c7572975-1168-4b29-be73-15d4cf7ec8a8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.168300 Jun 29 08:41:30.164945 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 340/649] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:29 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:31.187954 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:31.189003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:31.200479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:31.200930 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:31.201694 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:31.202123 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:31.342145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:31.350300 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:31.351812 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:31.353047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-77b9e8da-8134-4916-9478-4668d1f26a7e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1746 microversion: 2.20 time: 0.172373 Jun 29 08:41:31.353607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 310/650] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:31 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:32.371959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:32.373587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:32.380512 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:32.381062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:32.382086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:32.382617 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:32.550028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:32.559724 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:32.561638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:32.562838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d535929b-0ecf-4551-8dfb-af194e7aeb11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.195105 Jun 29 08:41:32.563394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 341/651] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:32 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:33.582316 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:33.582946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:33.590732 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:33.591177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:33.592189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:33.592825 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:33.734575 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:33.742807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:33.744313 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:33.746036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-880bb15e-743e-49b4-8d9c-7d4656bc61fc tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.168336 Jun 29 08:41:33.756435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 311/652] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:33 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:34.770110 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:34.771555 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:34.782362 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:34.783214 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:34.784412 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:34.785017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:34.928175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:34.938246 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:34.940236 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:34.941580 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6ab6dc5f-fba4-4967-bcb9-695ff8bd5358 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.176679 Jun 29 08:41:34.942275 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 342/653] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:34 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:35.960538 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:35.962051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:35.970012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:35.970814 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:35.971941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:35.972579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:36.114821 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:36.125891 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:36.127789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:36.128956 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4ac88ed4-a24f-49f2-bbfc-d12358823b60 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.172687 Jun 29 08:41:36.129978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 312/654] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:35 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:37.147457 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:37.148079 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:37.155742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:37.156193 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:37.156961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:37.157389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:37.314992 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:37.325706 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:37.327253 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:37.328434 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-98e0fdfe-1a18-4714-a6d5-133112c98bb7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.185076 Jun 29 08:41:37.328995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 343/655] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:37 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:38.348344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:38.349075 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:38.356408 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:38.357537 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:38.358004 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:38.358454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:38.531039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:38.542063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:38.544959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:38.547214 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2c5d9582-29da-4f6b-9bf8-252608c7c908 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.203563 Jun 29 08:41:38.547887 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 313/656] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:38 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:41:39.566095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:39.566762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:39.574530 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:39.575291 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:39.576049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:39.576749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:39.720005 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:39.728270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:39.729776 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:39.730960 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-98701342-9ccc-4cda-a639-9246d17f81d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.169180 Jun 29 08:41:39.731493 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 344/657] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:39 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:40.749730 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:40.750394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:40.758120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:40.758639 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:40.759447 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:40.759881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:40.899881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:40.908167 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:40.910377 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:40.911564 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ad0e8621-e942-4f1c-b32e-2dee76125194 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.166082 Jun 29 08:41:40.912149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 314/658] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:40 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:41:41.930520 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:41.931180 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:41.933678 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=44 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:41.939669 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:41.940105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:41.940873 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:41.941298 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:42.087717 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:42.097217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:42.098731 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:42.099951 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-064bac1f-dcab-43fa-b169-e33bc9847686 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.173975 Jun 29 08:41:42.110733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 345/659] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:41 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:43.118476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:43.119152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:43.122341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=40 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:43.129521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:43.129965 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:43.130749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:43.131190 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:43.266903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:43.275488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:43.276895 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:43.278039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-46c899bc-a033-490f-a01a-f3dc5cd78142 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.163627 Jun 29 08:41:43.278591 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 315/660] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:43 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:44.301681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:44.302331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:44.309092 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:44.309536 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:44.310296 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:44.310773 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:44.447636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:44.456885 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:44.458563 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:44.460004 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6e3aca3d-4beb-4b78-bfe8-4cd17e6042de tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.165197 Jun 29 08:41:44.461031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 346/661] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:44 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:45.479236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:45.479795 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:45.486827 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:45.487266 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:45.488026 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:45.488802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:45.622117 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:45.630555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:45.632085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:45.633245 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-013a10d6-277c-43e0-9f09-e27eb4b99ced tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1741 microversion: 2.20 time: 0.157956 Jun 29 08:41:45.633783 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 316/662] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:45 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:46.652767 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:46.653447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:46.661714 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:46.662227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:46.663153 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:46.663652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:46.809503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:46.818246 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:46.819976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:46.821112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-55eed446-d50f-49fe-b584-419dd2302e72 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1723 microversion: 2.20 time: 0.172993 Jun 29 08:41:46.821674 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 347/663] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:46 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:47.417176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d24f010a-87e0-456b-99c8-a4026f75e9b8 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:47.417705 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d24f010a-87e0-456b-99c8-a4026f75e9b8 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:47.424678 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d24f010a-87e0-456b-99c8-a4026f75e9b8 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:47.425124 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d24f010a-87e0-456b-99c8-a4026f75e9b8 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:47.425895 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d24f010a-87e0-456b-99c8-a4026f75e9b8 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:47.426321 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d24f010a-87e0-456b-99c8-a4026f75e9b8 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:47.522137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-d24f010a-87e0-456b-99c8-a4026f75e9b8 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lazy-loading 'services' on Instance uuid 7d081293-96bb-4377-b429-dea8a3d06c68 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:41:47.601955 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d24f010a-87e0-456b-99c8-a4026f75e9b8 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68/os-volume_attachments/19a71fed-c29f-49ea-a626-d9d732bc6f05" status: 202 len: 0 microversion: 2.1 time: 0.188597 Jun 29 08:41:47.602734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 317/664] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:41:47 2022] DELETE /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68/os-volume_attachments/19a71fed-c29f-49ea-a626-d9d732bc6f05 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:41:47.844419 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:47.845393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:47.853694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:47.854139 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:47.854923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:47.855369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:47.990975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:47.999402 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:48.000900 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:48.002045 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ee69830f-d5c9-4457-a391-a538d5d170d8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1723 microversion: 2.20 time: 0.164558 Jun 29 08:41:48.002604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 348/665] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:47 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:48.363236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-8921304f-d896-4f60-acb9-ea6ebe3e6d77 req-21127e56-fa8d-42b5-a3eb-c07b747c01cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdb4aec-5168-4f28-b336-45afe2620e64", "name": "network-vif-unplugged", "status": "completed", "tag": "4a2b788b-b706-4ae1-a969-16b817f7a8ad"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:48.372483 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-8921304f-d896-4f60-acb9-ea6ebe3e6d77 req-21127e56-fa8d-42b5-a3eb-c07b747c01cf service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:48.373069 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-8921304f-d896-4f60-acb9-ea6ebe3e6d77 req-21127e56-fa8d-42b5-a3eb-c07b747c01cf service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:48.386165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-8921304f-d896-4f60-acb9-ea6ebe3e6d77 req-21127e56-fa8d-42b5-a3eb-c07b747c01cf service nova] Creating event network-vif-unplugged:4a2b788b-b706-4ae1-a969-16b817f7a8ad for instance dcdb4aec-5168-4f28-b336-45afe2620e64 on hv-cinder-79760 Jun 29 08:41:48.391072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-8921304f-d896-4f60-acb9-ea6ebe3e6d77 req-21127e56-fa8d-42b5-a3eb-c07b747c01cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032277 Jun 29 08:41:48.391672 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 318/666] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:49.024916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:49.025823 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:49.036933 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:49.037390 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:49.038152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:49.038587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:49.193570 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:49.202110 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:49.203662 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:49.204812 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-33af117b-bd58-483a-a870-28b515543e36 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1723 microversion: 2.20 time: 0.186568 Jun 29 08:41:49.205380 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 349/667] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:49 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:50.228904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:50.230039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:50.244641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.245081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:50.245834 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.246256 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:50.383376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:50.391430 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:50.392941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:50.394077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9f178ad5-0396-4bbb-8764-90af25c55641 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1666 microversion: 2.20 time: 0.173148 Jun 29 08:41:50.394606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 319/668] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:50 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:50.412258 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-23c7d947-f54d-43e0-a9d0-694ad348d4cb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee4f692b-4bb7-4582-8d08-059778c4c408"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:50.413292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-23c7d947-f54d-43e0-a9d0-694ad348d4cb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:50.420251 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c7d947-f54d-43e0-a9d0-694ad348d4cb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.420688 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c7d947-f54d-43e0-a9d0-694ad348d4cb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:50.421435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c7d947-f54d-43e0-a9d0-694ad348d4cb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.421855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c7d947-f54d-43e0-a9d0-694ad348d4cb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:50.503394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:50.738262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-23c7d947-f54d-43e0-a9d0-694ad348d4cb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329915 Jun 29 08:41:50.738812 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 350/669] 10.222.0.27 () {62 vars in 1363 bytes} [Wed Jun 29 08:41:50 2022] POST /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:41:50.843467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f75ba052-4ab7-435f-8e96-a22855c7bd6c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:50.844072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f75ba052-4ab7-435f-8e96-a22855c7bd6c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:50.850508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f75ba052-4ab7-435f-8e96-a22855c7bd6c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.851091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f75ba052-4ab7-435f-8e96-a22855c7bd6c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:50.851890 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f75ba052-4ab7-435f-8e96-a22855c7bd6c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.852386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f75ba052-4ab7-435f-8e96-a22855c7bd6c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:50.858287 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2a4848f4-b2f2-40f4-9954-5646563d8fba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:50.858812 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2a4848f4-b2f2-40f4-9954-5646563d8fba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:50.867897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a4848f4-b2f2-40f4-9954-5646563d8fba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.868332 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a4848f4-b2f2-40f4-9954-5646563d8fba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:50.869307 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a4848f4-b2f2-40f4-9954-5646563d8fba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.869948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a4848f4-b2f2-40f4-9954-5646563d8fba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:50.879059 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f75ba052-4ab7-435f-8e96-a22855c7bd6c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:41:50.975482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f75ba052-4ab7-435f-8e96-a22855c7bd6c tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 204 len: 0 microversion: 2.1 time: 0.135827 Jun 29 08:41:50.976547 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 320/670] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:41:50 2022] DELETE /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:41:50.987077 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2a4848f4-b2f2-40f4-9954-5646563d8fba tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/action" status: 202 len: 0 microversion: 2.20 time: 0.132667 Jun 29 08:41:50.987760 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 351/671] 10.222.0.27 () {62 vars in 1318 bytes} [Wed Jun 29 08:41:50 2022] POST /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 29 08:41:50.991223 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-156ae2db-2693-4b4f-8dc1-0d16bdf0353d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:50.992120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-156ae2db-2693-4b4f-8dc1-0d16bdf0353d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:50.996516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:50.997118 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:50.998504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-156ae2db-2693-4b4f-8dc1-0d16bdf0353d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:50.999062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-156ae2db-2693-4b4f-8dc1-0d16bdf0353d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:51.000018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-156ae2db-2693-4b4f-8dc1-0d16bdf0353d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:51.000573 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-156ae2db-2693-4b4f-8dc1-0d16bdf0353d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:51.004447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:51.004926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:51.006106 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:51.006242 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:51.017257 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:41:51.207577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-156ae2db-2693-4b4f-8dc1-0d16bdf0353d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:51.214329 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:51.222131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-156ae2db-2693-4b4f-8dc1-0d16bdf0353d tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1515 microversion: 2.1 time: 0.239464 Jun 29 08:41:51.224102 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:51.226002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:51.227340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-41202670-04e1-4758-b62d-fa0bfbba6989 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1752 microversion: 2.20 time: 0.235414 Jun 29 08:41:51.233502 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 321/672] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:50 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:41:51.235304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 352/673] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:50 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1752 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:41:52.244739 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d5e9aa8c-2355-4c7e-a30b-a44ba6a5dbaf tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:52.245690 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d5e9aa8c-2355-4c7e-a30b-a44ba6a5dbaf tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:52.256706 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d5e9aa8c-2355-4c7e-a30b-a44ba6a5dbaf tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:52.257124 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d5e9aa8c-2355-4c7e-a30b-a44ba6a5dbaf tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:52.257592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:52.258036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d5e9aa8c-2355-4c7e-a30b-a44ba6a5dbaf tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:52.258290 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d5e9aa8c-2355-4c7e-a30b-a44ba6a5dbaf tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:52.258828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:52.266390 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:52.266855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:52.267617 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:52.268036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:52.456633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d5e9aa8c-2355-4c7e-a30b-a44ba6a5dbaf tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:52.461634 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:52.469182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d5e9aa8c-2355-4c7e-a30b-a44ba6a5dbaf tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1515 microversion: 2.1 time: 0.231020 Jun 29 08:41:52.469843 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 322/674] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:52 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:52.482250 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:52.483790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:52.484955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-01649df0-a422-4258-bc45-22db6ee77938 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1752 microversion: 2.20 time: 0.233363 Jun 29 08:41:52.489557 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 353/675] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:52 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1752 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:53.487572 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7d3e7ef8-5919-451e-884d-ea6d840f8f1a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:53.488830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7d3e7ef8-5919-451e-884d-ea6d840f8f1a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:53.496011 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d3e7ef8-5919-451e-884d-ea6d840f8f1a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:53.496463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d3e7ef8-5919-451e-884d-ea6d840f8f1a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:53.498334 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d3e7ef8-5919-451e-884d-ea6d840f8f1a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:53.498334 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d3e7ef8-5919-451e-884d-ea6d840f8f1a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:53.504878 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:53.506481 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:53.515535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:53.516325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:53.517388 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:53.517968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:53.712982 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7d3e7ef8-5919-451e-884d-ea6d840f8f1a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3be3323efb945f1ad6537bbc9eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1cc844419c14acd9a9e7dfb4233841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:53.725505 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7d3e7ef8-5919-451e-884d-ea6d840f8f1a tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 200 len: 1515 microversion: 2.1 time: 0.242468 Jun 29 08:41:53.726847 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 323/676] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:53 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:41:53.727751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:53.736357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:53.737988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:53.739271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b789193a-0104-4a3d-ae6e-f2694d791435 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1754 microversion: 2.20 time: 0.239357 Jun 29 08:41:53.740089 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 354/677] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:53 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1754 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:54.071180 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-2d87d011-362d-4435-b059-594a202c1785 req-7598dfa6-141d-4d45-bdb1-3a0ea392a217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d081293-96bb-4377-b429-dea8a3d06c68", "name": "network-vif-deleted", "tag": "c205761a-b8ec-4a08-8a24-bae2b9c03871"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:41:54.081275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-2d87d011-362d-4435-b059-594a202c1785 req-7598dfa6-141d-4d45-bdb1-3a0ea392a217 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:54.081712 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-2d87d011-362d-4435-b059-594a202c1785 req-7598dfa6-141d-4d45-bdb1-3a0ea392a217 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:54.095357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-2d87d011-362d-4435-b059-594a202c1785 req-7598dfa6-141d-4d45-bdb1-3a0ea392a217 service nova] Creating event network-vif-deleted:c205761a-b8ec-4a08-8a24-bae2b9c03871 for instance 7d081293-96bb-4377-b429-dea8a3d06c68 on hv-cinder-79760 Jun 29 08:41:54.100223 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-2d87d011-362d-4435-b059-594a202c1785 req-7598dfa6-141d-4d45-bdb1-3a0ea392a217 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032850 Jun 29 08:41:54.101028 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 324/678] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:41:54.743527 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:54.744171 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] [instance: 7d081293-96bb-4377-b429-dea8a3d06c68] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:54.750613 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:54.751067 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:54.752677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:54.752677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:54.758923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:54.759757 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:54.766149 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] HTTP exception thrown: Instance 7d081293-96bb-4377-b429-dea8a3d06c68 could not be found. Jun 29 08:41:54.767131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Request method failure captured: Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 HTTP/1.1 Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA-hhKnZ5b7Aiy2z4asGcty1hLsn1_yoWIvrVTSoLCjP0Goa5eUSBw00eJbfOWvAw9QdHsk-wYtlg4HZ34fsF_PkmCBTw5_rMJ9rkShoutKmbxbrkl5yV48bG_IGYsMnzo3G9hn7WJOIfATBq3vcSM4Vf5iTuUSNvQabI5PK50mkxcg Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: d1cc844419c14acd9a9e7dfb4233841d Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1832244675 Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:41:54.767824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1cc844419c14acd9a9e7dfb4233841d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1cc844419c14acd9a9e7dfb4233841d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1cc844419c14acd9a9e7dfb4233841d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1cc844419c14acd9a9e7dfb4233841d"}]}] Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesSnapshotTestJSON-1832244675 Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: d1cc844419c14acd9a9e7dfb4233841d Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1832244675 Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesSnapshotTestJSON-1832244675-project Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: e3be3323efb945f1ad6537bbc9eba7b0 Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesSnapshotTestJSON-1832244675-project Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 7d081293-96bb-4377-b429-dea8a3d06c68 could not be found. Jun 29 08:41:54.769206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '7d081293-96bb-4377-b429-dea8a3d06c68'} Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d081293-96bb-4377-b429-dea8a3d06c68 could not be found. Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:41:54.769977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d081293-96bb-4377-b429-dea8a3d06c68 could not be found. Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d081293-96bb-4377-b429-dea8a3d06c68 could not be found. Jun 29 08:41:54.771425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:41:54.772543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:54.772630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] Returning 404 to user: Instance 7d081293-96bb-4377-b429-dea8a3d06c68 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:41:54.773889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:54.773889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:54.774068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fed9d724-38b6-47d6-855e-a2ae19349092 tempest-VolumesSnapshotTestJSON-1832244675 tempest-VolumesSnapshotTestJSON-1832244675-project] 10.222.0.27 "GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68" status: 404 len: 111 microversion: 2.1 time: 0.030239 Jun 29 08:41:54.774068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 355/679] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:41:54 2022] GET /compute/v2.1/servers/7d081293-96bb-4377-b429-dea8a3d06c68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:41:54.925291 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:54.934636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:54.936475 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:54.937853 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-48cf5949-032c-447c-b72f-c60a5cfb8efa tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.183619 Jun 29 08:41:54.943300 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 325/680] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:54 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:55.961148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:55.961737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:55.969375 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:55.969806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:55.970604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:55.971048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:56.120913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:56.129627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:56.131990 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:56.133161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b02b5df5-62d9-4b72-a516-70c71dcadc11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.176306 Jun 29 08:41:56.133730 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 356/681] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:55 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:57.152619 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:57.153359 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:57.160156 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:57.160838 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:57.161746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:57.162312 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:57.341762 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:57.352810 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:57.365164 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:57.367474 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-48faebf1-36bf-4873-828a-ae6ccd89b967 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.219543 Jun 29 08:41:57.368378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 326/682] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:57 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:58.390416 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:58.391086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:58.398882 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:58.399331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:58.400087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:58.400531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:58.539954 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:58.548881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:58.550395 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:58.551579 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-94f6f36f-75a3-4e84-a359-78aed48e4555 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.167552 Jun 29 08:41:58.552126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 357/683] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:58 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:41:59.569198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:41:59.569808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:41:59.577468 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:59.577916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:59.578671 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:41:59.579129 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:41:59.712693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:59.721953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:59.723482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:41:59.724636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5c8b5efc-0f88-4fbb-a397-9fab866dab9b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.159394 Jun 29 08:41:59.725192 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 327/684] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:41:59 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:00.747399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:00.748074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:00.755718 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:00.756203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:00.757036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:00.757506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:00.910855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:00.920317 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:00.921818 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:00.922998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-40de1a72-8c5a-4f59-892b-4411a6b96213 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.182242 Jun 29 08:42:00.923552 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 358/685] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:00 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:01.943570 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:01.944306 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:01.953030 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:01.953516 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:01.954294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:01.954758 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:02.087800 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:42:02.088068 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 08:42:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 (ip 10.222.0.27) !!! Jun 29 08:42:02.097046 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:02.106105 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:02.107641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:02.108908 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ff332145-1049-4c79-bb41-3a3daa7b1a80 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.170418 Jun 29 08:42:02.109467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 328/686] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:01 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:03.132271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:03.133262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:03.143184 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:03.143621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:03.144382 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:03.144805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:03.292980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:03.302207 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:03.304066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:03.305391 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-245c0bc3-cc20-4841-84a5-498458586f44 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.180105 Jun 29 08:42:03.305966 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 359/687] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:03 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:04.329931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:04.330671 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:04.337410 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:04.337847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:04.338606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:04.339056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:04.363282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b07a6763-16d4-440e-85a0-c82e3ec16c73 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c79714c-f219-4185-ab77-528f697d15b4"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:42:04.364425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b07a6763-16d4-440e-85a0-c82e3ec16c73 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:04.370464 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b07a6763-16d4-440e-85a0-c82e3ec16c73 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:04.370939 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b07a6763-16d4-440e-85a0-c82e3ec16c73 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:04.371686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b07a6763-16d4-440e-85a0-c82e3ec16c73 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:04.372108 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b07a6763-16d4-440e-85a0-c82e3ec16c73 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:04.475285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:04.483686 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:04.485272 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:04.486406 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-21e42913-8317-41b4-bd28-4ab8eafd3052 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.160611 Jun 29 08:42:04.487010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 360/688] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:04 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:05.513789 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:05.514484 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:05.520840 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:05.521277 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:05.522032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:05.522461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:05.708347 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:05.720712 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:05.722224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:05.723445 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f90e2fb8-81aa-427e-a15d-6f1e06d60d91 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.216395 Jun 29 08:42:05.724211 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 361/689] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:05 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:42:06.742964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:06.743668 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:06.751023 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:06.751498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:06.752531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:06.753022 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:06.920979 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:06.929751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:06.931357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:06.932702 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9324c24f-aefe-4d0a-838a-832c94ec45b9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.193914 Jun 29 08:42:06.933406 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 362/690] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:06 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:07.951026 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:07.952420 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:07.959854 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:07.960332 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:07.961165 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:07.961585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:08.094016 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:08.104265 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:08.105363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:08.106504 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9c9bfde2-d0b8-48c1-be6e-588fc17d16ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.159749 Jun 29 08:42:08.107081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 363/691] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:07 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:42:09.126410 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:09.127694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:09.134965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:09.135435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:09.136741 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:09.137496 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:09.164113 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:09.294315 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:09.308278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:09.310092 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:09.311341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bf4086ab-42bc-4bad-acc4-539bde463038 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.190093 Jun 29 08:42:09.312232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 364/692] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:09 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:10.329923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:10.330638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:10.338074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:10.338503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:10.339496 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:10.340069 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:10.481482 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:10.492349 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:10.493903 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:10.495399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5ca86dc7-fa6e-4c83-ad57-6d9638bd5072 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.169401 Jun 29 08:42:10.496657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 365/693] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:10 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:42:11.518751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:11.519738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:11.527479 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:11.527922 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:11.528684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:11.529168 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:11.675870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:11.684765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:11.686262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:11.687443 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0b4583d6-88a0-4b2d-bd10-9ec0809e0122 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.175203 Jun 29 08:42:11.688002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 366/694] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:11 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:12.712837 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:12.714042 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:12.717635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=46 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:12.725998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:12.726434 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:12.727224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:12.727650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:12.868819 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:12.877474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:12.879001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:12.880152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-685fd58d-db7b-4cd4-b26e-01c3aae4c77d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.174173 Jun 29 08:42:12.880705 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 367/695] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:12 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:13.903073 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:13.903973 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:13.915362 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:13.916061 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:13.917295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:13.917974 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:14.052906 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:14.061552 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:14.063294 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:14.064467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d99f295a-1b26-4287-9c8d-5e655b72e5c0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.168305 Jun 29 08:42:14.065015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 368/696] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:13 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:14.368959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:14.443126 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=47 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:15.100097 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:15.100729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:15.107663 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:15.108103 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:15.108838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:15.109292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:15.243459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:15.252178 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:15.253665 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:15.254840 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-956f66fb-f53c-416f-987a-eb433e6234c7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.160900 Jun 29 08:42:15.255389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 369/697] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:15 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:16.276462 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:16.277257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:16.285615 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:16.286159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:16.287137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:16.287747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:16.428079 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:16.436942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:16.438431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:16.439608 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dbbcb62a-da2d-4eb7-a774-975238aa3d07 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.168882 Jun 29 08:42:16.440192 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 370/698] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:16 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:17.461738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:17.462420 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:17.469848 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:17.470288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:17.471083 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:17.471508 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:17.608523 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:17.617141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:17.618640 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:17.619820 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-43045620-ed39-4dcb-b698-f13a9ef42596 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.163586 Jun 29 08:42:17.620373 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 371/699] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:17 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:18.649083 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:18.650016 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:18.661051 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:18.661787 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:18.663173 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:18.663597 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:18.797645 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:18.806592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:18.808535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:18.809789 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c1c7f1ac-c5d8-4993-ae4d-67cb28afa24f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.167599 Jun 29 08:42:18.810341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 372/700] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:18 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:19.831409 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:19.832339 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:19.840112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:19.840906 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:19.841667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:19.842093 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:19.973023 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:19.981634 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:19.983154 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:19.984307 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-66c926e8-720b-4fb7-a28f-0f5124dc21d7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.158702 Jun 29 08:42:19.984866 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 373/701] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:19 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:20.851174 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b07a6763-16d4-440e-85a0-c82e3ec16c73 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.598547 Jun 29 08:42:20.851830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 329/702] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:42:04 2022] POST /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments => generated 194 bytes in 16600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:42:21.005636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:21.006338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:21.014439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:21.014914 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:21.015656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:21.016276 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:21.179191 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:21.188534 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:21.190166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:21.191429 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-193dfda9-1b2b-4c64-886a-2c5ce0e25107 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.189876 Jun 29 08:42:21.192027 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 374/703] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:21 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:22.214419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:22.215159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:22.225921 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:22.226410 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:22.227291 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:22.227767 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:22.363465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:22.372522 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:22.374006 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:22.375193 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c83fc7b4-f1b3-4683-94fe-1ce17d206a0c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.166905 Jun 29 08:42:22.375746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 330/704] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:22 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:23.393475 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:23.394114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:23.401860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:23.402394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:23.403175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:23.403605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:23.545484 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:23.554538 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:23.556075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:23.557218 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4b33c33c-716c-4c3d-9a07-1d9720348b88 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.167757 Jun 29 08:42:23.557848 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 375/705] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:23 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:24.576589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:24.577113 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:24.583761 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:24.584208 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:24.584963 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:24.585397 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:24.726426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:24.735343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:24.736830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:24.737971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-740519ad-7048-4acf-8274-b525de692ea8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.166145 Jun 29 08:42:24.738500 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 331/706] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:24 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:25.212199 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4c88d87f-b59a-4ed8-8c69-0bb9728834be tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:42:25.213314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4c88d87f-b59a-4ed8-8c69-0bb9728834be tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:25.221469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4c88d87f-b59a-4ed8-8c69-0bb9728834be tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:25.221917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4c88d87f-b59a-4ed8-8c69-0bb9728834be tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:25.222684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4c88d87f-b59a-4ed8-8c69-0bb9728834be tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:25.223141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4c88d87f-b59a-4ed8-8c69-0bb9728834be tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:25.246764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-4c88d87f-b59a-4ed8-8c69-0bb9728834be tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lazy-loading 'flavor' on Instance uuid 86b2d8b0-44c2-4e85-9d24-0c27d7164edf {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:42:25.376423 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4c88d87f-b59a-4ed8-8c69-0bb9728834be tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/action" status: 200 len: 32 microversion: 2.1 time: 0.168360 Jun 29 08:42:25.377152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 376/707] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:42:25 2022] POST /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:42:25.386463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-31f30016-8838-4ada-ae28-37aba1c16b20 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:25.387218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-31f30016-8838-4ada-ae28-37aba1c16b20 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:25.393624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-31f30016-8838-4ada-ae28-37aba1c16b20 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:25.394087 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-31f30016-8838-4ada-ae28-37aba1c16b20 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:25.394933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-31f30016-8838-4ada-ae28-37aba1c16b20 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:25.395328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-31f30016-8838-4ada-ae28-37aba1c16b20 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:25.533950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-31f30016-8838-4ada-ae28-37aba1c16b20 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:25.542262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-31f30016-8838-4ada-ae28-37aba1c16b20 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.159679 Jun 29 08:42:25.543169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 332/708] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:25 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:25.757321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:25.758017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:25.764803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:25.765246 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:25.766015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:25.766444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:25.903759 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:25.915527 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:25.917068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:25.918286 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f7ff1f20-745d-4e49-9542-f38b77001ae9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.165547 Jun 29 08:42:25.918888 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 377/709] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:25 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:26.561670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e71c6292-3052-4633-be41-c396ad046ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:26.562239 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e71c6292-3052-4633-be41-c396ad046ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:26.569301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e71c6292-3052-4633-be41-c396ad046ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:26.569736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e71c6292-3052-4633-be41-c396ad046ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:26.570484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e71c6292-3052-4633-be41-c396ad046ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:26.570945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e71c6292-3052-4633-be41-c396ad046ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:26.706727 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e71c6292-3052-4633-be41-c396ad046ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:26.718860 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e71c6292-3052-4633-be41-c396ad046ca6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.161048 Jun 29 08:42:26.719758 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 333/710] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:26 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:26.941187 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:26.941762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:26.950804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:26.951252 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:26.952015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:26.952445 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:27.102475 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:27.112065 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:27.113552 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:27.114716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a2f844f7-ff25-473a-9365-5c2ec677944e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.180867 Jun 29 08:42:27.115259 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 378/711] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:26 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:27.745609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-83a2ef73-0311-41ca-99a4-ff14b4440a6e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:27.746535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-83a2ef73-0311-41ca-99a4-ff14b4440a6e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:27.757444 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-83a2ef73-0311-41ca-99a4-ff14b4440a6e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:27.758164 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-83a2ef73-0311-41ca-99a4-ff14b4440a6e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:27.759443 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-83a2ef73-0311-41ca-99a4-ff14b4440a6e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:27.760149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-83a2ef73-0311-41ca-99a4-ff14b4440a6e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:27.903727 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-83a2ef73-0311-41ca-99a4-ff14b4440a6e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:27.915730 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-83a2ef73-0311-41ca-99a4-ff14b4440a6e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.175381 Jun 29 08:42:27.918784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 334/712] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:27 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:28.137702 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:28.139486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:28.150770 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:28.151509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:28.152733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:28.153621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:28.157794 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:28.307456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:28.316569 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:28.318072 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:28.319388 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1f8afbc2-da1b-435c-9dce-cb34a8b337c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.188133 Jun 29 08:42:28.319945 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 379/713] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:28 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:28.935939 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-19a1f2c1-9d4f-46b0-af53-4eee95e72fa6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:28.937143 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-19a1f2c1-9d4f-46b0-af53-4eee95e72fa6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:28.943836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19a1f2c1-9d4f-46b0-af53-4eee95e72fa6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:28.944284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19a1f2c1-9d4f-46b0-af53-4eee95e72fa6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:28.945210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19a1f2c1-9d4f-46b0-af53-4eee95e72fa6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:28.945975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19a1f2c1-9d4f-46b0-af53-4eee95e72fa6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:29.077543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-19a1f2c1-9d4f-46b0-af53-4eee95e72fa6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:29.085675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-19a1f2c1-9d4f-46b0-af53-4eee95e72fa6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.154048 Jun 29 08:42:29.086229 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 335/714] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:28 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:29.337459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:29.338681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:29.346157 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:29.346562 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:29.347427 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:29.347875 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:29.489580 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:29.498235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:29.499778 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:29.500926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4b31bc15-32fb-407e-a3f1-9dbe4b76bbce tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.167341 Jun 29 08:42:29.501478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 380/715] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:29 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:30.103530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-be91cba0-2ba5-407a-a343-371813af9c89 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:30.104378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-be91cba0-2ba5-407a-a343-371813af9c89 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:30.111748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be91cba0-2ba5-407a-a343-371813af9c89 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:30.112000 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be91cba0-2ba5-407a-a343-371813af9c89 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:30.112878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be91cba0-2ba5-407a-a343-371813af9c89 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:30.113205 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be91cba0-2ba5-407a-a343-371813af9c89 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:30.247185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-be91cba0-2ba5-407a-a343-371813af9c89 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:30.255449 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-be91cba0-2ba5-407a-a343-371813af9c89 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.156038 Jun 29 08:42:30.264025 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 336/716] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:30 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:30.521023 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:30.521752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:30.530134 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:30.530563 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:30.531420 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:30.531904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:30.754795 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:30.764372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:30.766189 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:30.767531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-32aa3785-505f-495d-9631-53c2083c3020 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.251923 Jun 29 08:42:30.768090 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 381/717] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:30 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:42:30.897967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-b79fea94-1676-462a-8271-300a56fc5d30 req-dec90f84-1e1e-4c52-89b2-d753b4b324d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdb4aec-5168-4f28-b336-45afe2620e64", "name": "network-vif-plugged", "status": "completed", "tag": "4a2b788b-b706-4ae1-a969-16b817f7a8ad"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:42:30.907824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-b79fea94-1676-462a-8271-300a56fc5d30 req-dec90f84-1e1e-4c52-89b2-d753b4b324d8 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:30.908340 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-b79fea94-1676-462a-8271-300a56fc5d30 req-dec90f84-1e1e-4c52-89b2-d753b4b324d8 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:30.923670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-b79fea94-1676-462a-8271-300a56fc5d30 req-dec90f84-1e1e-4c52-89b2-d753b4b324d8 service nova] Creating event network-vif-plugged:4a2b788b-b706-4ae1-a969-16b817f7a8ad for instance dcdb4aec-5168-4f28-b336-45afe2620e64 on hv-cinder-79760 Jun 29 08:42:30.929266 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-b79fea94-1676-462a-8271-300a56fc5d30 req-dec90f84-1e1e-4c52-89b2-d753b4b324d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035977 Jun 29 08:42:30.929950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 337/718] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:42:31.272988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-78968383-1af0-4e07-879d-f9bb1dfba782 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:31.273592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-78968383-1af0-4e07-879d-f9bb1dfba782 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:31.282622 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78968383-1af0-4e07-879d-f9bb1dfba782 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:31.283096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78968383-1af0-4e07-879d-f9bb1dfba782 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:31.283863 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78968383-1af0-4e07-879d-f9bb1dfba782 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:31.284273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78968383-1af0-4e07-879d-f9bb1dfba782 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:31.533679 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-78968383-1af0-4e07-879d-f9bb1dfba782 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:31.544719 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-78968383-1af0-4e07-879d-f9bb1dfba782 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.275527 Jun 29 08:42:31.546070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 382/719] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:31 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:31.787478 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:31.788927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:31.796419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:31.797134 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:31.798028 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:31.798533 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:32.260219 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:32.269422 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:32.270926 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:32.272080 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-819beeb1-3c98-46ab-8b30-9a29f17f941c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.490127 Jun 29 08:42:32.272634 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 338/720] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:31 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:32.561802 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-96ffe776-f892-4579-befe-47f0c6e71922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:32.563058 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-96ffe776-f892-4579-befe-47f0c6e71922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:32.570759 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96ffe776-f892-4579-befe-47f0c6e71922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:32.571302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96ffe776-f892-4579-befe-47f0c6e71922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:32.572250 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96ffe776-f892-4579-befe-47f0c6e71922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:32.572826 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96ffe776-f892-4579-befe-47f0c6e71922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:32.846431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-96ffe776-f892-4579-befe-47f0c6e71922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:32.855456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-96ffe776-f892-4579-befe-47f0c6e71922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.297546 Jun 29 08:42:32.857410 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 383/721] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:32 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:33.289766 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:33.291050 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:33.297955 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:33.298423 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:33.299346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:33.299759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:33.537042 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:33.546817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:33.549357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:33.551362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-916cbc44-0a2b-4f3b-983c-582046b2ae53 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.265606 Jun 29 08:42:33.552350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 339/722] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:33 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:33.873643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0e436f97-53ed-4df7-8ac2-7fad29233ba6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:33.874855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0e436f97-53ed-4df7-8ac2-7fad29233ba6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:33.882513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e436f97-53ed-4df7-8ac2-7fad29233ba6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:33.883214 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e436f97-53ed-4df7-8ac2-7fad29233ba6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:33.884141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e436f97-53ed-4df7-8ac2-7fad29233ba6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:33.884720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e436f97-53ed-4df7-8ac2-7fad29233ba6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:34.148128 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0e436f97-53ed-4df7-8ac2-7fad29233ba6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:34.158137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0e436f97-53ed-4df7-8ac2-7fad29233ba6 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.288544 Jun 29 08:42:34.159059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 384/723] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:33 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:34.575121 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:34.577027 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:34.587553 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:34.588347 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:34.589328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:34.589961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:34.924331 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:34.934286 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:34.936345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:34.937681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bdb50d8e-23f5-4b72-8bbe-5a7690f8fca8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1810 microversion: 2.20 time: 0.371584 Jun 29 08:42:34.938450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 340/724] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:34 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1810 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:35.176159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-283b495a-361d-4f7e-ba34-265fc889d599 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:35.177660 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-283b495a-361d-4f7e-ba34-265fc889d599 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:35.192309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-283b495a-361d-4f7e-ba34-265fc889d599 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:35.192754 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-283b495a-361d-4f7e-ba34-265fc889d599 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:35.193531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-283b495a-361d-4f7e-ba34-265fc889d599 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:35.193958 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-283b495a-361d-4f7e-ba34-265fc889d599 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:35.348810 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-283b495a-361d-4f7e-ba34-265fc889d599 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:35.371984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-283b495a-361d-4f7e-ba34-265fc889d599 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.199764 Jun 29 08:42:35.383032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 385/725] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:35 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:35.958305 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:35.960077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:35.968438 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:35.968873 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:35.969642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:35.970061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:36.156721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:36.165587 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:36.167112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:36.168250 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bff5f03f-5d2a-4c88-a0b2-096f824f0365 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1797 microversion: 2.20 time: 0.216089 Jun 29 08:42:36.182279 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 341/726] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:42:35 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1797 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:42:36.389952 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fe515589-1986-4ac4-8bea-a2a730c65986 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:36.390641 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fe515589-1986-4ac4-8bea-a2a730c65986 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:36.399456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fe515589-1986-4ac4-8bea-a2a730c65986 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:36.399900 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fe515589-1986-4ac4-8bea-a2a730c65986 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:36.400681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fe515589-1986-4ac4-8bea-a2a730c65986 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:36.401104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fe515589-1986-4ac4-8bea-a2a730c65986 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:36.621945 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fe515589-1986-4ac4-8bea-a2a730c65986 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:36.631737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fe515589-1986-4ac4-8bea-a2a730c65986 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.246119 Jun 29 08:42:36.642614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 386/727] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:36 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:42:37.649626 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-50c654b6-e209-4a82-8d70-5c766a5d5793 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:37.650230 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-50c654b6-e209-4a82-8d70-5c766a5d5793 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:37.662016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50c654b6-e209-4a82-8d70-5c766a5d5793 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:37.662472 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50c654b6-e209-4a82-8d70-5c766a5d5793 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:37.665386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50c654b6-e209-4a82-8d70-5c766a5d5793 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:37.665907 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50c654b6-e209-4a82-8d70-5c766a5d5793 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:37.877247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-50c654b6-e209-4a82-8d70-5c766a5d5793 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:37.900210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-50c654b6-e209-4a82-8d70-5c766a5d5793 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.254475 Jun 29 08:42:37.905445 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 342/728] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:37 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:38.922241 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cc279a43-b65e-4ed3-949f-6781f22ccc9a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:38.922872 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cc279a43-b65e-4ed3-949f-6781f22ccc9a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:38.932958 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc279a43-b65e-4ed3-949f-6781f22ccc9a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:38.933401 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc279a43-b65e-4ed3-949f-6781f22ccc9a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:38.934171 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc279a43-b65e-4ed3-949f-6781f22ccc9a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:38.934591 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc279a43-b65e-4ed3-949f-6781f22ccc9a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:39.096199 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cc279a43-b65e-4ed3-949f-6781f22ccc9a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:39.104450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cc279a43-b65e-4ed3-949f-6781f22ccc9a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.186713 Jun 29 08:42:39.105258 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 387/729] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:38 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:40.122943 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1ae49ccd-45de-468f-81c2-fbcaa88a080c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:40.123550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1ae49ccd-45de-468f-81c2-fbcaa88a080c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:40.131025 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1ae49ccd-45de-468f-81c2-fbcaa88a080c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:40.131495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1ae49ccd-45de-468f-81c2-fbcaa88a080c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:40.132784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1ae49ccd-45de-468f-81c2-fbcaa88a080c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:40.133454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1ae49ccd-45de-468f-81c2-fbcaa88a080c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:40.290734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1ae49ccd-45de-468f-81c2-fbcaa88a080c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:40.300917 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1ae49ccd-45de-468f-81c2-fbcaa88a080c tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.182080 Jun 29 08:42:40.302739 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 343/730] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:40 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:40.496109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fbd82fb4-c8e3-40ed-8cc5-9c93b7d0f556 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Action: 'create', calling method: .version_select at 0x7fade40d2280>, body: {"keypair": {"name": "tempest-TestShelveInstance-457451613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzRX1pQdWudLBazbr8In3q4ckjnDllK9/83Sfn9eQNihQGoE5SublgbwhGjyHEZpCWeEECFfk0+drrjebQtfFE2/ZQ5UrUBFpIqFD+vuTEGAyU1ZmVNqiQzo0WS9FV4zg=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:42:40.510638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-fbd82fb4-c8e3-40ed-8cc5-9c93b7d0f556 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Getting quotas for project 40b4ce1d85294063aea6df4b9638c90f. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:42:40.514719 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-fbd82fb4-c8e3-40ed-8cc5-9c93b7d0f556 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Getting quotas for user 215c8b04d6294311aeb1124b9139c7fc and project 40b4ce1d85294063aea6df4b9638c90f. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:42:40.540765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fbd82fb4-c8e3-40ed-8cc5-9c93b7d0f556 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.240859 Jun 29 08:42:40.541424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 388/731] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:42:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:42:41.319532 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0833213b-f6b5-417b-b825-a44afd66347f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:41.320135 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0833213b-f6b5-417b-b825-a44afd66347f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:41.327149 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0833213b-f6b5-417b-b825-a44afd66347f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:41.327587 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0833213b-f6b5-417b-b825-a44afd66347f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:41.328353 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0833213b-f6b5-417b-b825-a44afd66347f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:41.328947 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0833213b-f6b5-417b-b825-a44afd66347f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:41.526373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0833213b-f6b5-417b-b825-a44afd66347f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:41.535202 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0833213b-f6b5-417b-b825-a44afd66347f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.219504 Jun 29 08:42:41.536662 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 344/732] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:41 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:42.554128 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-32f86f6b-2eba-4dc9-b70a-830bcd585956 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:42.554935 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-32f86f6b-2eba-4dc9-b70a-830bcd585956 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:42.562778 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32f86f6b-2eba-4dc9-b70a-830bcd585956 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:42.563500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32f86f6b-2eba-4dc9-b70a-830bcd585956 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:42.564582 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32f86f6b-2eba-4dc9-b70a-830bcd585956 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:42.565162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32f86f6b-2eba-4dc9-b70a-830bcd585956 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:42.726103 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-32f86f6b-2eba-4dc9-b70a-830bcd585956 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:42.745790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-32f86f6b-2eba-4dc9-b70a-830bcd585956 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1734 microversion: 2.1 time: 0.192354 Jun 29 08:42:42.747176 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 389/733] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:42 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:43.764750 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f36b0011-f309-478b-8bf0-a7ad40f116eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:43.765139 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f36b0011-f309-478b-8bf0-a7ad40f116eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:43.771128 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f36b0011-f309-478b-8bf0-a7ad40f116eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:43.771803 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f36b0011-f309-478b-8bf0-a7ad40f116eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:43.772870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f36b0011-f309-478b-8bf0-a7ad40f116eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:43.773195 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f36b0011-f309-478b-8bf0-a7ad40f116eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:43.912324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f36b0011-f309-478b-8bf0-a7ad40f116eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:43.916049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:43.921431 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f36b0011-f309-478b-8bf0-a7ad40f116eb tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1714 microversion: 2.1 time: 0.161447 Jun 29 08:42:43.922011 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 345/734] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:43 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:44.032010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:44.032548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:44.034981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:44.040803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:44.041330 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:44.042114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:44.042528 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:44.180712 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] HTTP exception thrown: Cannot 'detach_volume' instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf while it is in vm_state rescued Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Request method failure captured: Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments/5c79714c-f219-4185-ab77-528f697d15b4 HTTP/1.1 Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7FQdokTaeGJQNjt-Zh-T_72ZIosTruGY34RQQGF3CuMCucL-NzwfI1LMeJQdYqJxdI52SbBBLbUF2WBxubSMX8i43QQfqMVuS-_FPiG8NVTwoSioRUYIeZfSiMUSeT6sA91CET2FnsLyd4oP--fhYZhW2EdAaSpSsURItcg-4mMkk Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:42:44.182343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96872c14d1224c92b3247285f03bb966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96872c14d1224c92b3247285f03bb966"}]}] Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: ac984d1f6efa403e85483bd7fa78000e Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:42:44.183846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Cannot 'detach_volume' instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf while it is in vm_state rescued Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'server_id': '86b2d8b0-44c2-4e85-9d24-0c27d7164edf', 'id': '5c79714c-f219-4185-ab77-528f697d15b4'} Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:42:44.184533 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf while it is in vm_state rescued Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf while it is in vm_state rescued Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:42:44.186231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Returning 409 to user: Cannot 'detach_volume' instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf while it is in vm_state rescued {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:42:44.188328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-269bbbea-7d9e-4c41-ad75-1ab1cac7b7ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments/5c79714c-f219-4185-ab77-528f697d15b4" status: 409 len: 152 microversion: 2.1 time: 0.155900 Jun 29 08:42:44.188328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 390/735] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:42:44 2022] DELETE /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments/5c79714c-f219-4185-ab77-528f697d15b4 => generated 152 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 08:42:44.192871 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-68902eb6-b263-4218-bd84-f932d8810089 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:42:44.193390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-68902eb6-b263-4218-bd84-f932d8810089 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:44.200395 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68902eb6-b263-4218-bd84-f932d8810089 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:44.200832 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68902eb6-b263-4218-bd84-f932d8810089 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:44.201592 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68902eb6-b263-4218-bd84-f932d8810089 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:44.202014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-68902eb6-b263-4218-bd84-f932d8810089 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:44.281017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-68902eb6-b263-4218-bd84-f932d8810089 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "POST /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/action" status: 202 len: 0 microversion: 2.1 time: 0.091908 Jun 29 08:42:44.281921 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 346/736] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:42:44 2022] POST /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:42:44.291057 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-59ccd160-aaaa-4ba4-a596-4549af305ac5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:44.291908 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-59ccd160-aaaa-4ba4-a596-4549af305ac5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:44.300459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ccd160-aaaa-4ba4-a596-4549af305ac5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:44.301240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ccd160-aaaa-4ba4-a596-4549af305ac5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:44.302523 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ccd160-aaaa-4ba4-a596-4549af305ac5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:44.303986 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ccd160-aaaa-4ba4-a596-4549af305ac5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:44.460092 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-59ccd160-aaaa-4ba4-a596-4549af305ac5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:44.472048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-59ccd160-aaaa-4ba4-a596-4549af305ac5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1722 microversion: 2.1 time: 0.185146 Jun 29 08:42:44.472619 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 391/737] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:44 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:42:45.491528 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-eb42fad2-c4e8-440d-a57f-a70f0596eaa3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:45.492236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-eb42fad2-c4e8-440d-a57f-a70f0596eaa3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:45.494144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=35 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:45.500160 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eb42fad2-c4e8-440d-a57f-a70f0596eaa3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:45.500596 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eb42fad2-c4e8-440d-a57f-a70f0596eaa3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:45.501346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eb42fad2-c4e8-440d-a57f-a70f0596eaa3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:45.501771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eb42fad2-c4e8-440d-a57f-a70f0596eaa3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:45.645829 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-eb42fad2-c4e8-440d-a57f-a70f0596eaa3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:45.656674 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-eb42fad2-c4e8-440d-a57f-a70f0596eaa3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1722 microversion: 2.1 time: 0.170158 Jun 29 08:42:45.657229 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 347/738] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:45 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:46.677025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d119ef3b-8b7e-4d7c-9745-03a25f4841d9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:46.677679 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d119ef3b-8b7e-4d7c-9745-03a25f4841d9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:46.685656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d119ef3b-8b7e-4d7c-9745-03a25f4841d9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:46.686175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d119ef3b-8b7e-4d7c-9745-03a25f4841d9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:46.687110 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d119ef3b-8b7e-4d7c-9745-03a25f4841d9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:46.687620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d119ef3b-8b7e-4d7c-9745-03a25f4841d9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:46.833772 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d119ef3b-8b7e-4d7c-9745-03a25f4841d9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:46.842505 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d119ef3b-8b7e-4d7c-9745-03a25f4841d9 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1722 microversion: 2.1 time: 0.171463 Jun 29 08:42:46.843139 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 392/739] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:46 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:47.861071 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f8014ff2-b607-4249-b247-8a00a64558e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:47.861678 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f8014ff2-b607-4249-b247-8a00a64558e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:47.868727 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f8014ff2-b607-4249-b247-8a00a64558e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:47.869170 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f8014ff2-b607-4249-b247-8a00a64558e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:47.869925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f8014ff2-b607-4249-b247-8a00a64558e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:47.870353 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f8014ff2-b607-4249-b247-8a00a64558e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:48.009424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f8014ff2-b607-4249-b247-8a00a64558e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:48.018278 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f8014ff2-b607-4249-b247-8a00a64558e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1722 microversion: 2.1 time: 0.161199 Jun 29 08:42:48.018886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 348/740] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:47 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:49.040577 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-94f6c96c-ffb0-409a-b5bb-1bcb0f9bdb3e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:49.041496 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-94f6c96c-ffb0-409a-b5bb-1bcb0f9bdb3e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:49.051230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94f6c96c-ffb0-409a-b5bb-1bcb0f9bdb3e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:49.051675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94f6c96c-ffb0-409a-b5bb-1bcb0f9bdb3e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:49.052441 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94f6c96c-ffb0-409a-b5bb-1bcb0f9bdb3e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:49.052870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94f6c96c-ffb0-409a-b5bb-1bcb0f9bdb3e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:49.185659 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-94f6c96c-ffb0-409a-b5bb-1bcb0f9bdb3e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:49.194399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-94f6c96c-ffb0-409a-b5bb-1bcb0f9bdb3e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1722 microversion: 2.1 time: 0.160351 Jun 29 08:42:49.195009 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 393/741] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:49 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:50.214148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-13db68db-4eb3-419d-b620-93f22cc9070e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:50.214742 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-13db68db-4eb3-419d-b620-93f22cc9070e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:50.225082 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-13db68db-4eb3-419d-b620-93f22cc9070e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:50.225721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-13db68db-4eb3-419d-b620-93f22cc9070e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:50.226859 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-13db68db-4eb3-419d-b620-93f22cc9070e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:50.227465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-13db68db-4eb3-419d-b620-93f22cc9070e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:50.363944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-13db68db-4eb3-419d-b620-93f22cc9070e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:42:50.372325 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-13db68db-4eb3-419d-b620-93f22cc9070e tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1728 microversion: 2.1 time: 0.163934 Jun 29 08:42:50.373390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 349/742] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:42:50 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:42:50.394947 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2ee40c9c-6780-4e19-83ae-24b02a1d2976 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:42:50.395623 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2ee40c9c-6780-4e19-83ae-24b02a1d2976 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:42:50.403615 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ee40c9c-6780-4e19-83ae-24b02a1d2976 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:50.404047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ee40c9c-6780-4e19-83ae-24b02a1d2976 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:50.404843 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ee40c9c-6780-4e19-83ae-24b02a1d2976 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:50.405263 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ee40c9c-6780-4e19-83ae-24b02a1d2976 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:50.486676 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2ee40c9c-6780-4e19-83ae-24b02a1d2976 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097298 Jun 29 08:42:50.487374 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 394/743] 10.222.0.27 () {58 vars in 1274 bytes} [Wed Jun 29 08:42:50 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:42:51.677747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-c0fd0067-f47b-4dd9-9677-6f0ebc4676ec req-7ac81809-5a30-4791-858c-14451ff72c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b2d8b0-44c2-4e85-9d24-0c27d7164edf", "tag": "0bca97cc-eb16-48a9-938f-a393ebc2d7f4"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:42:51.685976 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-c0fd0067-f47b-4dd9-9677-6f0ebc4676ec req-7ac81809-5a30-4791-858c-14451ff72c21 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:51.686410 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-c0fd0067-f47b-4dd9-9677-6f0ebc4676ec req-7ac81809-5a30-4791-858c-14451ff72c21 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:51.697809 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-c0fd0067-f47b-4dd9-9677-6f0ebc4676ec req-7ac81809-5a30-4791-858c-14451ff72c21 service nova] Creating event network-changed:0bca97cc-eb16-48a9-938f-a393ebc2d7f4 for instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf on hv-cinder-79760 Jun 29 08:42:51.703053 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-c0fd0067-f47b-4dd9-9677-6f0ebc4676ec req-7ac81809-5a30-4791-858c-14451ff72c21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Jun 29 08:42:51.703901 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 350/744] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:42:53.721118 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=4 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:42:53.726189 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-51ab6c5e-e6f8-4dee-9cff-9a359e4f6565 req-af6e6d0c-67f7-4db9-a954-3632c40a582a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b2d8b0-44c2-4e85-9d24-0c27d7164edf", "tag": "0bca97cc-eb16-48a9-938f-a393ebc2d7f4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:42:53.734685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-51ab6c5e-e6f8-4dee-9cff-9a359e4f6565 req-af6e6d0c-67f7-4db9-a954-3632c40a582a service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:42:53.735156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-51ab6c5e-e6f8-4dee-9cff-9a359e4f6565 req-af6e6d0c-67f7-4db9-a954-3632c40a582a service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:42:53.746733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-51ab6c5e-e6f8-4dee-9cff-9a359e4f6565 req-af6e6d0c-67f7-4db9-a954-3632c40a582a service nova] Creating event network-changed:0bca97cc-eb16-48a9-938f-a393ebc2d7f4 for instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf on hv-cinder-79760 Jun 29 08:42:53.752426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-51ab6c5e-e6f8-4dee-9cff-9a359e4f6565 req-af6e6d0c-67f7-4db9-a954-3632c40a582a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031916 Jun 29 08:42:53.753592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 395/745] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:43:10.689010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=7 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:10.689787 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:10.694303 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1723325185", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-457451613", "security_groups": [{"name": "tempest-secgroup-smoke-601009026"}], "networks": [{"uuid": "da42ae72-957f-44a4-a0fd-c737b609690b"}], "block_device_mapping_v2": [{"uuid": "a57b5401-1a20-4162-83be-bb69b1621809", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:43:10.807919 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] validate_networks() for [('da42ae72-957f-44a4-a0fd-c737b609690b', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:43:11.207482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:43:11.207971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:43:11.208501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:43:11.209031 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:43:11.209437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:43:11.218943 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:11.219381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:11.220168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:11.220678 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:11.239130 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Getting quotas for project 40b4ce1d85294063aea6df4b9638c90f. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:43:11.243165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Getting quotas for user 215c8b04d6294311aeb1124b9139c7fc and project 40b4ce1d85294063aea6df4b9638c90f. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:43:11.302923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:43:11.305160 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a57b5401-1a20-4162-83be-bb69b1621809',volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:43:11.435482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-12b3be50-32fb-4f5f-854f-706e6968879f tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747983 Jun 29 08:43:11.436141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 351/746] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:43:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:43:11.444110 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=11 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:11.444968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=88 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:11.449735 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ad8ea3bd-84c9-4731-84c4-a50376fc3e72 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:11.450424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ad8ea3bd-84c9-4731-84c4-a50376fc3e72 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:11.513643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ad8ea3bd-84c9-4731-84c4-a50376fc3e72 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:11.523629 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ad8ea3bd-84c9-4731-84c4-a50376fc3e72 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1088 microversion: 2.1 time: 0.081093 Jun 29 08:43:11.524444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 396/747] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:11 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:12.543038 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-05f68693-b810-4cae-ab4f-9be48c0ed0b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:12.544044 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-05f68693-b810-4cae-ab4f-9be48c0ed0b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:12.550957 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-05f68693-b810-4cae-ab4f-9be48c0ed0b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:12.551479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-05f68693-b810-4cae-ab4f-9be48c0ed0b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:12.552342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-05f68693-b810-4cae-ab4f-9be48c0ed0b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:12.552837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-05f68693-b810-4cae-ab4f-9be48c0ed0b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:12.617675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-05f68693-b810-4cae-ab4f-9be48c0ed0b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:12.625085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-05f68693-b810-4cae-ab4f-9be48c0ed0b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1194 microversion: 2.1 time: 0.086923 Jun 29 08:43:12.625646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 352/748] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:12 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:13.644305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-24cbb219-5c9e-414e-aede-31afe92aeb1d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:13.645605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-24cbb219-5c9e-414e-aede-31afe92aeb1d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:13.653412 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24cbb219-5c9e-414e-aede-31afe92aeb1d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:13.653851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24cbb219-5c9e-414e-aede-31afe92aeb1d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:13.654612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24cbb219-5c9e-414e-aede-31afe92aeb1d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:13.655203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24cbb219-5c9e-414e-aede-31afe92aeb1d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:13.809831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-24cbb219-5c9e-414e-aede-31afe92aeb1d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:13.820059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-24cbb219-5c9e-414e-aede-31afe92aeb1d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.179625 Jun 29 08:43:13.821107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 397/749] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:13 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:13.974056 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-d9ea2bf3-ba8c-4fd1-ae1d-7ca0f95488fc req-eac28947-42c7-4e51-b2c2-2010285abdcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbea51b8-1348-4834-badb-56258435cd06", "tag": "d7fdedc4-9082-4237-a3a6-f3fe54501c3f"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:43:13.995161 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-d9ea2bf3-ba8c-4fd1-ae1d-7ca0f95488fc req-eac28947-42c7-4e51-b2c2-2010285abdcf service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:13.995612 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-d9ea2bf3-ba8c-4fd1-ae1d-7ca0f95488fc req-eac28947-42c7-4e51-b2c2-2010285abdcf service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:14.008597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-d9ea2bf3-ba8c-4fd1-ae1d-7ca0f95488fc req-eac28947-42c7-4e51-b2c2-2010285abdcf service nova] Creating event network-changed:d7fdedc4-9082-4237-a3a6-f3fe54501c3f for instance cbea51b8-1348-4834-badb-56258435cd06 on hv-cinder-79760 Jun 29 08:43:14.014224 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-d9ea2bf3-ba8c-4fd1-ae1d-7ca0f95488fc req-eac28947-42c7-4e51-b2c2-2010285abdcf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053803 Jun 29 08:43:14.014870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 353/750] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:43:14.841908 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f410e167-c88a-4849-abc8-ed01de590349 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:14.843002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f410e167-c88a-4849-abc8-ed01de590349 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:14.855529 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f410e167-c88a-4849-abc8-ed01de590349 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:14.856312 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f410e167-c88a-4849-abc8-ed01de590349 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:14.857605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f410e167-c88a-4849-abc8-ed01de590349 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:14.858357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f410e167-c88a-4849-abc8-ed01de590349 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:15.012817 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f410e167-c88a-4849-abc8-ed01de590349 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:15.022471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f410e167-c88a-4849-abc8-ed01de590349 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.187425 Jun 29 08:43:15.023042 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 398/751] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:14 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:16.043765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-274d50b8-7d8a-4760-add1-034d7273a35c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:16.044687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-274d50b8-7d8a-4760-add1-034d7273a35c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:16.053083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-274d50b8-7d8a-4760-add1-034d7273a35c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:16.053630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-274d50b8-7d8a-4760-add1-034d7273a35c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:16.054557 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-274d50b8-7d8a-4760-add1-034d7273a35c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:16.055392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-274d50b8-7d8a-4760-add1-034d7273a35c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:16.193783 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-274d50b8-7d8a-4760-add1-034d7273a35c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:16.201398 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-274d50b8-7d8a-4760-add1-034d7273a35c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.164136 Jun 29 08:43:16.201954 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 354/752] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:16 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:17.223049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c4dad92d-1ecf-4f79-8fe1-4e7740c57a52 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:17.223897 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c4dad92d-1ecf-4f79-8fe1-4e7740c57a52 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:17.235383 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4dad92d-1ecf-4f79-8fe1-4e7740c57a52 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:17.236117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4dad92d-1ecf-4f79-8fe1-4e7740c57a52 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:17.237343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4dad92d-1ecf-4f79-8fe1-4e7740c57a52 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:17.238044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4dad92d-1ecf-4f79-8fe1-4e7740c57a52 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:17.376978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c4dad92d-1ecf-4f79-8fe1-4e7740c57a52 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:17.389459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c4dad92d-1ecf-4f79-8fe1-4e7740c57a52 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.173429 Jun 29 08:43:17.390317 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 399/753] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:17 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:18.413602 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-24fa8e74-acba-4b37-b022-d1dfddd45996 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:18.414623 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-24fa8e74-acba-4b37-b022-d1dfddd45996 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:18.421752 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-24fa8e74-acba-4b37-b022-d1dfddd45996 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:18.422210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-24fa8e74-acba-4b37-b022-d1dfddd45996 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:18.423076 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-24fa8e74-acba-4b37-b022-d1dfddd45996 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:18.423499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-24fa8e74-acba-4b37-b022-d1dfddd45996 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:18.557228 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-24fa8e74-acba-4b37-b022-d1dfddd45996 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:18.565137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-24fa8e74-acba-4b37-b022-d1dfddd45996 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.157999 Jun 29 08:43:18.565699 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 355/754] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:18 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:19.589893 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-16256ce7-ffa1-492d-aa07-e7d315d4656c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:19.590912 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-16256ce7-ffa1-492d-aa07-e7d315d4656c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:19.598522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-16256ce7-ffa1-492d-aa07-e7d315d4656c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:19.599046 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-16256ce7-ffa1-492d-aa07-e7d315d4656c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:19.599888 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-16256ce7-ffa1-492d-aa07-e7d315d4656c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:19.600362 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-16256ce7-ffa1-492d-aa07-e7d315d4656c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:19.746720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-16256ce7-ffa1-492d-aa07-e7d315d4656c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:19.756576 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-16256ce7-ffa1-492d-aa07-e7d315d4656c tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.171670 Jun 29 08:43:19.757430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 400/755] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:19 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:43:20.776731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c06697dd-d2ff-4f2e-b325-0200b3898f96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:20.777419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c06697dd-d2ff-4f2e-b325-0200b3898f96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:20.786957 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c06697dd-d2ff-4f2e-b325-0200b3898f96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:20.787550 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c06697dd-d2ff-4f2e-b325-0200b3898f96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:20.788566 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c06697dd-d2ff-4f2e-b325-0200b3898f96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:20.789139 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c06697dd-d2ff-4f2e-b325-0200b3898f96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:20.929663 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c06697dd-d2ff-4f2e-b325-0200b3898f96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:20.938183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c06697dd-d2ff-4f2e-b325-0200b3898f96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.166718 Jun 29 08:43:20.938785 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 356/756] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:20 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:21.959353 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2a2e8e88-f3c2-4443-849b-b4fe5d6d1bf9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:21.960347 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2a2e8e88-f3c2-4443-849b-b4fe5d6d1bf9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:21.964085 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:21.973424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a2e8e88-f3c2-4443-849b-b4fe5d6d1bf9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:21.974146 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a2e8e88-f3c2-4443-849b-b4fe5d6d1bf9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:21.975432 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a2e8e88-f3c2-4443-849b-b4fe5d6d1bf9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:21.976135 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a2e8e88-f3c2-4443-849b-b4fe5d6d1bf9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:22.112064 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2a2e8e88-f3c2-4443-849b-b4fe5d6d1bf9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:22.120171 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2a2e8e88-f3c2-4443-849b-b4fe5d6d1bf9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.167296 Jun 29 08:43:22.120734 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 401/757] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:21 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:23.136962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d22c77a2-b8d0-4855-8e8f-79686bb1a3f2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:23.137789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d22c77a2-b8d0-4855-8e8f-79686bb1a3f2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:23.140243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:23.140852 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:23.147225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d22c77a2-b8d0-4855-8e8f-79686bb1a3f2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:23.147666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d22c77a2-b8d0-4855-8e8f-79686bb1a3f2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:23.148498 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d22c77a2-b8d0-4855-8e8f-79686bb1a3f2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:23.149636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d22c77a2-b8d0-4855-8e8f-79686bb1a3f2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:23.288217 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d22c77a2-b8d0-4855-8e8f-79686bb1a3f2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:23.300738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d22c77a2-b8d0-4855-8e8f-79686bb1a3f2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.168035 Jun 29 08:43:23.301661 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 357/758] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:23 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:24.322722 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6683e2b6-93e7-4f92-b713-1fb534c2ab6d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:24.323338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6683e2b6-93e7-4f92-b713-1fb534c2ab6d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:24.330397 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6683e2b6-93e7-4f92-b713-1fb534c2ab6d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:24.330967 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6683e2b6-93e7-4f92-b713-1fb534c2ab6d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:24.331733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6683e2b6-93e7-4f92-b713-1fb534c2ab6d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:24.332161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6683e2b6-93e7-4f92-b713-1fb534c2ab6d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:24.477938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6683e2b6-93e7-4f92-b713-1fb534c2ab6d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:24.485800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6683e2b6-93e7-4f92-b713-1fb534c2ab6d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.169175 Jun 29 08:43:24.486367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 402/759] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:24 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:25.316211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-14a6a3a1-bf10-4bdd-be13-22ae0fb68649 req-a166c702-94ee-4843-98c3-22f06cc35bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbea51b8-1348-4834-badb-56258435cd06", "name": "network-vif-plugged", "status": "completed", "tag": "d7fdedc4-9082-4237-a3a6-f3fe54501c3f"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:43:25.325210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-14a6a3a1-bf10-4bdd-be13-22ae0fb68649 req-a166c702-94ee-4843-98c3-22f06cc35bc2 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:25.325674 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-14a6a3a1-bf10-4bdd-be13-22ae0fb68649 req-a166c702-94ee-4843-98c3-22f06cc35bc2 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:25.337552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-14a6a3a1-bf10-4bdd-be13-22ae0fb68649 req-a166c702-94ee-4843-98c3-22f06cc35bc2 service nova] Creating event network-vif-plugged:d7fdedc4-9082-4237-a3a6-f3fe54501c3f for instance cbea51b8-1348-4834-badb-56258435cd06 on hv-cinder-79760 Jun 29 08:43:25.343003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-14a6a3a1-bf10-4bdd-be13-22ae0fb68649 req-a166c702-94ee-4843-98c3-22f06cc35bc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030737 Jun 29 08:43:25.343772 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 358/760] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:43:25.504672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3d256369-124f-4042-964a-93b4416a7019 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:25.505435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3d256369-124f-4042-964a-93b4416a7019 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:25.514551 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d256369-124f-4042-964a-93b4416a7019 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:25.515181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d256369-124f-4042-964a-93b4416a7019 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:25.516181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d256369-124f-4042-964a-93b4416a7019 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:25.516772 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d256369-124f-4042-964a-93b4416a7019 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:25.687437 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3d256369-124f-4042-964a-93b4416a7019 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:25.695435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3d256369-124f-4042-964a-93b4416a7019 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.195913 Jun 29 08:43:25.695994 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 403/761] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:25 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:26.719164 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6ada88c9-9a17-4e2b-abd0-18602c71a678 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:26.720293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6ada88c9-9a17-4e2b-abd0-18602c71a678 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:26.730675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6ada88c9-9a17-4e2b-abd0-18602c71a678 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:26.731127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6ada88c9-9a17-4e2b-abd0-18602c71a678 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:26.732240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6ada88c9-9a17-4e2b-abd0-18602c71a678 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:26.732808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6ada88c9-9a17-4e2b-abd0-18602c71a678 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:26.877234 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6ada88c9-9a17-4e2b-abd0-18602c71a678 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:26.885266 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6ada88c9-9a17-4e2b-abd0-18602c71a678 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.174658 Jun 29 08:43:26.885857 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 359/762] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:26 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:27.902753 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c92bf849-764d-4262-8663-9832e9961f34 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:27.903406 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c92bf849-764d-4262-8663-9832e9961f34 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:27.910156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c92bf849-764d-4262-8663-9832e9961f34 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:27.910600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c92bf849-764d-4262-8663-9832e9961f34 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:27.911411 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c92bf849-764d-4262-8663-9832e9961f34 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:27.911838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c92bf849-764d-4262-8663-9832e9961f34 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:28.057400 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c92bf849-764d-4262-8663-9832e9961f34 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:28.065386 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c92bf849-764d-4262-8663-9832e9961f34 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1259 microversion: 2.1 time: 0.166960 Jun 29 08:43:28.069660 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 404/763] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:27 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:29.087373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3e0e6cd9-201e-408f-8017-f11c5ee9c79a tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:29.088064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3e0e6cd9-201e-408f-8017-f11c5ee9c79a tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:29.096181 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3e0e6cd9-201e-408f-8017-f11c5ee9c79a tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:29.096702 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3e0e6cd9-201e-408f-8017-f11c5ee9c79a tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:29.097587 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3e0e6cd9-201e-408f-8017-f11c5ee9c79a tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:29.098081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3e0e6cd9-201e-408f-8017-f11c5ee9c79a tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:29.243252 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3e0e6cd9-201e-408f-8017-f11c5ee9c79a tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:29.250937 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3e0e6cd9-201e-408f-8017-f11c5ee9c79a tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1442 microversion: 2.1 time: 0.170593 Jun 29 08:43:29.251522 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 360/764] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:29 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1442 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:29.275059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0c7e8d4a-09c3-4b66-a62e-b49a329c33ca tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:29.275667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0c7e8d4a-09c3-4b66-a62e-b49a329c33ca tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:29.282553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0c7e8d4a-09c3-4b66-a62e-b49a329c33ca tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:29.283031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0c7e8d4a-09c3-4b66-a62e-b49a329c33ca tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:29.283798 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0c7e8d4a-09c3-4b66-a62e-b49a329c33ca tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:29.284226 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0c7e8d4a-09c3-4b66-a62e-b49a329c33ca tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:29.421497 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0c7e8d4a-09c3-4b66-a62e-b49a329c33ca tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:29.429059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0c7e8d4a-09c3-4b66-a62e-b49a329c33ca tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1442 microversion: 2.1 time: 0.160142 Jun 29 08:43:29.429634 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 405/765] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:29 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:31.472856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-8bfdce19-3953-45c3-902d-8dbb20c03cab req-568a8e03-855d-497a-a949-310147bf435e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbea51b8-1348-4834-badb-56258435cd06", "tag": "d7fdedc4-9082-4237-a3a6-f3fe54501c3f"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:43:31.481707 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-8bfdce19-3953-45c3-902d-8dbb20c03cab req-568a8e03-855d-497a-a949-310147bf435e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:31.482140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-8bfdce19-3953-45c3-902d-8dbb20c03cab req-568a8e03-855d-497a-a949-310147bf435e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:31.492740 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-8bfdce19-3953-45c3-902d-8dbb20c03cab req-568a8e03-855d-497a-a949-310147bf435e service nova] Creating event network-changed:d7fdedc4-9082-4237-a3a6-f3fe54501c3f for instance cbea51b8-1348-4834-badb-56258435cd06 on hv-cinder-79760 Jun 29 08:43:31.497901 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-8bfdce19-3953-45c3-902d-8dbb20c03cab req-568a8e03-855d-497a-a949-310147bf435e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028718 Jun 29 08:43:31.498551 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 361/766] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:43:47.471117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c8223073-c5e3-45af-9729-36581971631d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:47.471847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c8223073-c5e3-45af-9729-36581971631d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:47.474758 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=22 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:47.475741 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=54 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:47.484243 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c8223073-c5e3-45af-9729-36581971631d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:47.484690 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c8223073-c5e3-45af-9729-36581971631d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:47.485470 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c8223073-c5e3-45af-9729-36581971631d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:47.485903 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c8223073-c5e3-45af-9729-36581971631d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:47.510461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c8223073-c5e3-45af-9729-36581971631d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0/ips" status: 200 len: 150 microversion: 2.1 time: 0.046782 Jun 29 08:43:47.511056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 406/767] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:43:47 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:43:47.519689 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:47.520448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=50 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:43:47.525431 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a504e02f-7328-48dc-adfa-a9d88628ca0a"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:43:47.526583 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:47.534040 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:47.534485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:47.535272 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:47.535702 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:47.617246 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Invalid volume: volume a504e02f-7328-48dc-adfa-a9d88628ca0a is already attached to instances: 16ff4bf7-d905-4584-98f7-26236c14a7d8 Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: POST /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0/os-volume_attachments HTTP/1.1 Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 74 Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:43:47.619014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {"volumeAttachment": {"volumeId": "a504e02f-7328-48dc-adfa-a9d88628ca0a"}} Jun 29 08:43:47.620655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Invalid volume: volume a504e02f-7328-48dc-adfa-a9d88628ca0a is already attached to instances: 16ff4bf7-d905-4584-98f7-26236c14a7d8 Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'server_id': '1cd027a5-b0e0-4883-a88f-a55e9fdb57f0', 'body': {'volumeAttachment': {'volumeId': 'a504e02f-7328-48dc-adfa-a9d88628ca0a'}}} Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a504e02f-7328-48dc-adfa-a9d88628ca0a is already attached to instances: 16ff4bf7-d905-4584-98f7-26236c14a7d8 Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:47.621781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a504e02f-7328-48dc-adfa-a9d88628ca0a is already attached to instances: 16ff4bf7-d905-4584-98f7-26236c14a7d8 Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:47.623775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:43:47.625531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:43:47.625531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:43:47.625531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:43:47.625531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a504e02f-7328-48dc-adfa-a9d88628ca0a is already attached to instances: 16ff4bf7-d905-4584-98f7-26236c14a7d8 Jun 29 08:43:47.625531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:47.625531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 400 to user: Invalid volume: volume a504e02f-7328-48dc-adfa-a9d88628ca0a is already attached to instances: 16ff4bf7-d905-4584-98f7-26236c14a7d8 {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:43:47.625531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3eadfdda-8261-4028-80ec-ce1a0081f123 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102365 Jun 29 08:43:47.625531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 362/768] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:43:47 2022] POST /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:43:47.629541 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cdb1e561-30a5-406b-b6c5-63e95d6ec7a7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:47.630040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cdb1e561-30a5-406b-b6c5-63e95d6ec7a7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:47.636325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cdb1e561-30a5-406b-b6c5-63e95d6ec7a7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:47.636785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cdb1e561-30a5-406b-b6c5-63e95d6ec7a7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:47.637539 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cdb1e561-30a5-406b-b6c5-63e95d6ec7a7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:47.637970 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cdb1e561-30a5-406b-b6c5-63e95d6ec7a7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:47.663895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cdb1e561-30a5-406b-b6c5-63e95d6ec7a7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:43:47.751340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cdb1e561-30a5-406b-b6c5-63e95d6ec7a7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 204 len: 0 microversion: 2.1 time: 0.125324 Jun 29 08:43:47.751885 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 407/769] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:43:47 2022] DELETE /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:43:47.763385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-09a92d96-01ed-4999-a8f5-0106dcbed844 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:47.764925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-09a92d96-01ed-4999-a8f5-0106dcbed844 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:47.775386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09a92d96-01ed-4999-a8f5-0106dcbed844 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:47.775992 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09a92d96-01ed-4999-a8f5-0106dcbed844 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:47.777133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09a92d96-01ed-4999-a8f5-0106dcbed844 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:47.777759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09a92d96-01ed-4999-a8f5-0106dcbed844 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:47.920013 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-09a92d96-01ed-4999-a8f5-0106dcbed844 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:47.932350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-09a92d96-01ed-4999-a8f5-0106dcbed844 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1682 microversion: 2.1 time: 0.174419 Jun 29 08:43:47.933115 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 363/770] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:47 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:48.955968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0a986792-b152-4b10-9851-da84342a2ee4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:48.957175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0a986792-b152-4b10-9851-da84342a2ee4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:48.968917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a986792-b152-4b10-9851-da84342a2ee4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:48.969657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a986792-b152-4b10-9851-da84342a2ee4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:48.970950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a986792-b152-4b10-9851-da84342a2ee4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:48.971670 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a986792-b152-4b10-9851-da84342a2ee4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:49.117472 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0a986792-b152-4b10-9851-da84342a2ee4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:49.125387 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0a986792-b152-4b10-9851-da84342a2ee4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1682 microversion: 2.1 time: 0.176741 Jun 29 08:43:49.125978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 408/771] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:48 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:50.142953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0c842da2-0569-4a07-ab43-05dbcbe4d1c7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:50.143645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0c842da2-0569-4a07-ab43-05dbcbe4d1c7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:50.150630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c842da2-0569-4a07-ab43-05dbcbe4d1c7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:50.151133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c842da2-0569-4a07-ab43-05dbcbe4d1c7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:50.151867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c842da2-0569-4a07-ab43-05dbcbe4d1c7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:50.152294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0c842da2-0569-4a07-ab43-05dbcbe4d1c7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:50.415295 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0c842da2-0569-4a07-ab43-05dbcbe4d1c7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:50.423765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0c842da2-0569-4a07-ab43-05dbcbe4d1c7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1682 microversion: 2.1 time: 0.284869 Jun 29 08:43:50.424343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 364/772] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:50 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:51.017543 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-07f1b6c1-b87d-4ff2-9bbe-18ea55885a21 req-1e9d8644-9910-444d-b2e5-fa699bda0581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd027a5-b0e0-4883-a88f-a55e9fdb57f0", "name": "network-vif-deleted", "tag": "e98372bd-530d-490d-bea4-fdd0f9209c46"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:43:51.027869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-07f1b6c1-b87d-4ff2-9bbe-18ea55885a21 req-1e9d8644-9910-444d-b2e5-fa699bda0581 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:51.028568 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-07f1b6c1-b87d-4ff2-9bbe-18ea55885a21 req-1e9d8644-9910-444d-b2e5-fa699bda0581 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:51.045017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-07f1b6c1-b87d-4ff2-9bbe-18ea55885a21 req-1e9d8644-9910-444d-b2e5-fa699bda0581 service nova] Creating event network-vif-deleted:e98372bd-530d-490d-bea4-fdd0f9209c46 for instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 on hv-cinder-79760 Jun 29 08:43:51.050923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-07f1b6c1-b87d-4ff2-9bbe-18ea55885a21 req-1e9d8644-9910-444d-b2e5-fa699bda0581 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037009 Jun 29 08:43:51.052072 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 409/773] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:43:51.441559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:51.443440 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:51.455284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:51.456079 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:51.457183 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:51.457875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:51.499303 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:51.500250 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:51.500965 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lazy-loading 'fault' on Instance uuid 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:43:51.556684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:51.565332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-caef4093-13b0-4610-8e2c-8f328fbe093e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 200 len: 1331 microversion: 2.1 time: 0.128184 Jun 29 08:43:51.575365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 365/774] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:51 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:52.583498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:52.584226 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:52.591775 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:52.592217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:52.593001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:52.593428 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:52.606809 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 HTTP/1.1 Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:43:52.608469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:43:52.609815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '1cd027a5-b0e0-4883-a88f-a55e9fdb57f0'} Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:43:52.610808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:43:52.612341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:43:52.613447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:43:52.613447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-65d19a6b-9004-4280-b29e-87b372ae574d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 404 len: 111 microversion: 2.1 time: 0.030760 Jun 29 08:43:52.613447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 410/775] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:52 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:43:52.619077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7965d20d-314c-41b1-b171-424b8a9dfa0a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '.version_select at 0x7fade41074c0>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:52.644747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7965d20d-314c-41b1-b171-424b8a9dfa0a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188896370" status: 202 len: 0 microversion: 2.1 time: 0.029454 Jun 29 08:43:52.645301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 366/776] 10.222.0.27 () {58 vars in 1220 bytes} [Wed Jun 29 08:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188896370 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:43:53.341226 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dca64e4e-ff16-456b-9ac2-38e66a642b51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:53.341717 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dca64e4e-ff16-456b-9ac2-38e66a642b51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:53.348235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dca64e4e-ff16-456b-9ac2-38e66a642b51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:53.348674 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dca64e4e-ff16-456b-9ac2-38e66a642b51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:53.349429 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dca64e4e-ff16-456b-9ac2-38e66a642b51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:53.349847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dca64e4e-ff16-456b-9ac2-38e66a642b51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:53.431562 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-dca64e4e-ff16-456b-9ac2-38e66a642b51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lazy-loading 'services' on Instance uuid 16ff4bf7-d905-4584-98f7-26236c14a7d8 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:43:53.553225 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dca64e4e-ff16-456b-9ac2-38e66a642b51 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments/a504e02f-7328-48dc-adfa-a9d88628ca0a" status: 202 len: 0 microversion: 2.1 time: 0.216112 Jun 29 08:43:53.553836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 411/777] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:43:53 2022] DELETE /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments/a504e02f-7328-48dc-adfa-a9d88628ca0a => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:43:53.562655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9573eb19-8e7f-412a-b5de-9ca604a7a092 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:53.563661 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9573eb19-8e7f-412a-b5de-9ca604a7a092 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:53.571831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9573eb19-8e7f-412a-b5de-9ca604a7a092 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:53.572346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9573eb19-8e7f-412a-b5de-9ca604a7a092 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:53.573072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9573eb19-8e7f-412a-b5de-9ca604a7a092 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:53.573504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9573eb19-8e7f-412a-b5de-9ca604a7a092 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:53.603734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9573eb19-8e7f-412a-b5de-9ca604a7a092 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045226 Jun 29 08:43:53.604284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 367/778] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:43:53 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:43:54.616639 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-abe0d7d5-b3af-4bf1-9df4-595f2209f139 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:54.617742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-abe0d7d5-b3af-4bf1-9df4-595f2209f139 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:54.625439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-abe0d7d5-b3af-4bf1-9df4-595f2209f139 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:54.625925 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-abe0d7d5-b3af-4bf1-9df4-595f2209f139 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:54.626661 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-abe0d7d5-b3af-4bf1-9df4-595f2209f139 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:54.627124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-abe0d7d5-b3af-4bf1-9df4-595f2209f139 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:54.657654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-abe0d7d5-b3af-4bf1-9df4-595f2209f139 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Jun 29 08:43:54.658245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 412/779] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:43:54 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:43:55.674177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-22a7cba4-06cd-4c6c-871d-c9f7831ac2a3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:55.675740 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-22a7cba4-06cd-4c6c-871d-c9f7831ac2a3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:55.686496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22a7cba4-06cd-4c6c-871d-c9f7831ac2a3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:55.687288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22a7cba4-06cd-4c6c-871d-c9f7831ac2a3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:55.688300 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22a7cba4-06cd-4c6c-871d-c9f7831ac2a3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:55.689001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-22a7cba4-06cd-4c6c-871d-c9f7831ac2a3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:55.719409 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-22a7cba4-06cd-4c6c-871d-c9f7831ac2a3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052258 Jun 29 08:43:55.719887 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 368/780] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:43:55 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:43:55.777224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f679b1a1-0347-462d-8e47-7681d6739bba tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:55.777740 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f679b1a1-0347-462d-8e47-7681d6739bba tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:55.784726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f679b1a1-0347-462d-8e47-7681d6739bba tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:55.785158 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f679b1a1-0347-462d-8e47-7681d6739bba tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:55.785905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f679b1a1-0347-462d-8e47-7681d6739bba tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:55.786325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f679b1a1-0347-462d-8e47-7681d6739bba tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:55.811516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f679b1a1-0347-462d-8e47-7681d6739bba tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:43:55.893393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f679b1a1-0347-462d-8e47-7681d6739bba tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 204 len: 0 microversion: 2.1 time: 0.119592 Jun 29 08:43:55.894027 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 413/781] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:43:55 2022] DELETE /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:43:55.903084 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dc3ecff3-746a-4455-8f05-e349bbbaf023 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:55.903681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-dc3ecff3-746a-4455-8f05-e349bbbaf023 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:55.909934 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dc3ecff3-746a-4455-8f05-e349bbbaf023 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:55.910367 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dc3ecff3-746a-4455-8f05-e349bbbaf023 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:55.911151 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dc3ecff3-746a-4455-8f05-e349bbbaf023 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:55.911567 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dc3ecff3-746a-4455-8f05-e349bbbaf023 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:56.046411 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-dc3ecff3-746a-4455-8f05-e349bbbaf023 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:56.054542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dc3ecff3-746a-4455-8f05-e349bbbaf023 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1680 microversion: 2.1 time: 0.155521 Jun 29 08:43:56.055129 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 369/782] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:55 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:43:57.077014 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-759826af-64da-4d86-a8cf-d146d8e6f82e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:57.078149 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-759826af-64da-4d86-a8cf-d146d8e6f82e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:57.089223 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-759826af-64da-4d86-a8cf-d146d8e6f82e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:57.089955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-759826af-64da-4d86-a8cf-d146d8e6f82e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:57.091644 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-759826af-64da-4d86-a8cf-d146d8e6f82e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:57.092354 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-759826af-64da-4d86-a8cf-d146d8e6f82e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:57.318837 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-759826af-64da-4d86-a8cf-d146d8e6f82e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:57.326503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-759826af-64da-4d86-a8cf-d146d8e6f82e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1680 microversion: 2.1 time: 0.256675 Jun 29 08:43:57.327217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 414/783] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:57 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:58.080099 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-be2b0eea-8c62-4f53-903a-161ed8295d04 req-37d23347-0e63-4988-803f-2db847901987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ff4bf7-d905-4584-98f7-26236c14a7d8", "name": "network-vif-deleted", "tag": "2ed55c94-eef8-437e-ba0f-2a7792313f0d"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:43:58.088898 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-be2b0eea-8c62-4f53-903a-161ed8295d04 req-37d23347-0e63-4988-803f-2db847901987 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:58.089364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-be2b0eea-8c62-4f53-903a-161ed8295d04 req-37d23347-0e63-4988-803f-2db847901987 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:58.101534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-be2b0eea-8c62-4f53-903a-161ed8295d04 req-37d23347-0e63-4988-803f-2db847901987 service nova] Creating event network-vif-deleted:2ed55c94-eef8-437e-ba0f-2a7792313f0d for instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 on hv-cinder-79760 Jun 29 08:43:58.106738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-be2b0eea-8c62-4f53-903a-161ed8295d04 req-37d23347-0e63-4988-803f-2db847901987 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030387 Jun 29 08:43:58.107802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 370/784] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:43:58.346771 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:58.348166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:58.354894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:58.355335 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:58.356091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:58.356515 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:58.387585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:58.388032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:58.388468 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lazy-loading 'fault' on Instance uuid 16ff4bf7-d905-4584-98f7-26236c14a7d8 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:43:58.429933 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:43:58.437411 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-11f8f589-1c9b-4091-9474-d8ed257160d0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 200 len: 1330 microversion: 2.1 time: 0.095718 Jun 29 08:43:58.437995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 415/785] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:58 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:43:59.459281 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:59.459961 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:43:59.469926 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:59.470362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:59.471158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:43:59.471585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:43:59.485662 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 HTTP/1.1 Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:43:59.487327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:43:59.488798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '16ff4bf7-d905-4584-98f7-26236c14a7d8'} Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:43:59.489636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:43:59.490970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:43:59.492226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:43:59.492226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3695eda1-5247-41d3-87ee-d09b237de6d1 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 404 len: 111 microversion: 2.1 time: 0.036891 Jun 29 08:43:59.492226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 371/786] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:43:59 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:43:59.498088 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8a5e2cec-9bc2-4942-9b4e-df44f03d2d9c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '.version_select at 0x7fade40fa3a0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:43:59.520040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8a5e2cec-9bc2-4942-9b4e-df44f03d2d9c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-197090399" status: 202 len: 0 microversion: 2.1 time: 0.025635 Jun 29 08:43:59.520790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 416/787] 10.222.0.27 () {58 vars in 1217 bytes} [Wed Jun 29 08:43:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-197090399 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:44:00.220135 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d68bf2e9-8270-4b8d-ac0c-a1242126d663 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: .version_select at 0x7fade7971820>, body: {"keypair": {"name": "tempest-keypair-1102382217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrCAXx5/aSU/gKtbm9OoETemNz6pDUKk1PZ20oC4cXkNo+zi+EiBcgIDUIQJtRX2scAXtpGOf9jdvxuJIm/AjSrEubMZxzwoKw3Be1TbD/6TgdhSxa9MjhHAD/O4RKyaw=="}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:00.234233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-d68bf2e9-8270-4b8d-ac0c-a1242126d663 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:44:00.238360 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-d68bf2e9-8270-4b8d-ac0c-a1242126d663 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for user bccf002d9da34d1dad0ee71b5b7bb1c1 and project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:44:00.263150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d68bf2e9-8270-4b8d-ac0c-a1242126d663 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047612 Jun 29 08:44:00.263752 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 372/788] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:44:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:01.870720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-225770318", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fbe4e8a-ed08-40e1-b1bc-8913ebef6d94"}], "security_groups": [{"name": "tempest-securitygroup--1846871208"}], "key_name": "tempest-keypair-1102382217", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:01.985364 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] validate_networks() for [('7fbe4e8a-ed08-40e1-b1bc-8913ebef6d94', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:44:02.359338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:44:02.359779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:44:02.360459 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:44:02.360915 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:44:02.361400 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:44:02.376682 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:02.377124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:02.377913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:02.378340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:02.395833 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:44:02.400131 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for user bccf002d9da34d1dad0ee71b5b7bb1c1 and project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:44:02.412049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:44:02.414302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:44:02.463358 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e5b96b64-4616-4670-84f1-463b153dca42 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597519 Jun 29 08:44:02.463975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 417/789] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:44:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:44:02.477430 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e432bf9c-260b-4204-bfc1-262e0c6036d6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:02.478014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e432bf9c-260b-4204-bfc1-262e0c6036d6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:02.533857 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e432bf9c-260b-4204-bfc1-262e0c6036d6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:02.540845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e432bf9c-260b-4204-bfc1-262e0c6036d6 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1241 microversion: 2.1 time: 0.067755 Jun 29 08:44:02.541443 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 373/790] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:02 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:03.558589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f0bd6026-8b09-4e47-b5fc-f518f0b424d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:03.559298 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f0bd6026-8b09-4e47-b5fc-f518f0b424d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:03.566254 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0bd6026-8b09-4e47-b5fc-f518f0b424d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:03.566712 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0bd6026-8b09-4e47-b5fc-f518f0b424d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:03.567508 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0bd6026-8b09-4e47-b5fc-f518f0b424d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:03.568132 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0bd6026-8b09-4e47-b5fc-f518f0b424d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:03.639896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f0bd6026-8b09-4e47-b5fc-f518f0b424d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:03.648771 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f0bd6026-8b09-4e47-b5fc-f518f0b424d3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1301 microversion: 2.1 time: 0.094782 Jun 29 08:44:03.649455 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 418/791] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:03 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:04.665595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ff906e69-3fb6-46f7-ae0c-15d56c893011 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:04.666212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ff906e69-3fb6-46f7-ae0c-15d56c893011 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:04.673336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff906e69-3fb6-46f7-ae0c-15d56c893011 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:04.673893 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff906e69-3fb6-46f7-ae0c-15d56c893011 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:04.674713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff906e69-3fb6-46f7-ae0c-15d56c893011 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:04.675144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ff906e69-3fb6-46f7-ae0c-15d56c893011 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:04.879876 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ff906e69-3fb6-46f7-ae0c-15d56c893011 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:04.890029 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ff906e69-3fb6-46f7-ae0c-15d56c893011 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.228303 Jun 29 08:44:04.890682 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 374/792] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:04 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:05.163684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-a7183baa-8a93-4d3f-8a84-e442582605f1 req-fe1337da-87f4-4300-9319-beedb74d6b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9", "tag": "f0a90872-a515-411d-a8fc-fb4523dd5f0a"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:05.182815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a7183baa-8a93-4d3f-8a84-e442582605f1 req-fe1337da-87f4-4300-9319-beedb74d6b7e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:05.183328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a7183baa-8a93-4d3f-8a84-e442582605f1 req-fe1337da-87f4-4300-9319-beedb74d6b7e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:05.196010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-a7183baa-8a93-4d3f-8a84-e442582605f1 req-fe1337da-87f4-4300-9319-beedb74d6b7e service nova] Creating event network-changed:f0a90872-a515-411d-a8fc-fb4523dd5f0a for instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 on hv-cinder-79760 Jun 29 08:44:05.201126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-a7183baa-8a93-4d3f-8a84-e442582605f1 req-fe1337da-87f4-4300-9319-beedb74d6b7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041270 Jun 29 08:44:05.201872 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 419/793] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:05.911328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6495ed45-3982-4f71-ab65-c1794a1daf8b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:05.912277 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6495ed45-3982-4f71-ab65-c1794a1daf8b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:05.923365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6495ed45-3982-4f71-ab65-c1794a1daf8b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:05.923809 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6495ed45-3982-4f71-ab65-c1794a1daf8b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:05.924576 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6495ed45-3982-4f71-ab65-c1794a1daf8b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:05.925013 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6495ed45-3982-4f71-ab65-c1794a1daf8b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:06.054152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6495ed45-3982-4f71-ab65-c1794a1daf8b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:06.061916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6495ed45-3982-4f71-ab65-c1794a1daf8b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.157337 Jun 29 08:44:06.062476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 375/794] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:05 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:07.084408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-58faf60b-a0a0-41c5-837c-c737dd63109c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:07.085142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-58faf60b-a0a0-41c5-837c-c737dd63109c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:07.092518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58faf60b-a0a0-41c5-837c-c737dd63109c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:07.092962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58faf60b-a0a0-41c5-837c-c737dd63109c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:07.093723 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58faf60b-a0a0-41c5-837c-c737dd63109c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:07.094152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58faf60b-a0a0-41c5-837c-c737dd63109c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:07.260699 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-58faf60b-a0a0-41c5-837c-c737dd63109c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:07.268841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-58faf60b-a0a0-41c5-837c-c737dd63109c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.189346 Jun 29 08:44:07.269413 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 420/795] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:07 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:08.179692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e9a594d0-251c-4878-9dc0-18c9fcb67b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:08.180305 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e9a594d0-251c-4878-9dc0-18c9fcb67b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:08.187213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e9a594d0-251c-4878-9dc0-18c9fcb67b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:08.187656 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e9a594d0-251c-4878-9dc0-18c9fcb67b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:08.188455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e9a594d0-251c-4878-9dc0-18c9fcb67b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:08.188907 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e9a594d0-251c-4878-9dc0-18c9fcb67b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:08.222144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e9a594d0-251c-4878-9dc0-18c9fcb67b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments/ee4f692b-4bb7-4582-8d08-059778c4c408" status: 200 len: 194 microversion: 2.20 time: 0.046473 Jun 29 08:44:08.222714 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 376/796] 10.222.0.27 () {60 vars in 1453 bytes} [Wed Jun 29 08:44:08 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments/ee4f692b-4bb7-4582-8d08-059778c4c408 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:44:08.285450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-687d9995-ff3d-468e-848f-16380b0f5135 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:08.286107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-687d9995-ff3d-468e-848f-16380b0f5135 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:08.293132 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-687d9995-ff3d-468e-848f-16380b0f5135 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:08.293521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dc8a619a-29ad-4b90-8641-8be190b8315e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:08.293685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-687d9995-ff3d-468e-848f-16380b0f5135 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:08.294010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-dc8a619a-29ad-4b90-8641-8be190b8315e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:08.294320 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-687d9995-ff3d-468e-848f-16380b0f5135 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:08.294739 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-687d9995-ff3d-468e-848f-16380b0f5135 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:08.300869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dc8a619a-29ad-4b90-8641-8be190b8315e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:08.301413 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dc8a619a-29ad-4b90-8641-8be190b8315e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:08.302201 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dc8a619a-29ad-4b90-8641-8be190b8315e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:08.302621 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dc8a619a-29ad-4b90-8641-8be190b8315e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:08.383409 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-dc8a619a-29ad-4b90-8641-8be190b8315e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lazy-loading 'services' on Instance uuid dcdb4aec-5168-4f28-b336-45afe2620e64 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:44:08.425480 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-687d9995-ff3d-468e-848f-16380b0f5135 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:08.432991 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-687d9995-ff3d-468e-848f-16380b0f5135 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.151416 Jun 29 08:44:08.433486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 421/797] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:08 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:08.458120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dc8a619a-29ad-4b90-8641-8be190b8315e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments/ee4f692b-4bb7-4582-8d08-059778c4c408" status: 202 len: 0 microversion: 2.20 time: 0.168701 Jun 29 08:44:08.458995 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 377/798] 10.222.0.27 () {60 vars in 1456 bytes} [Wed Jun 29 08:44:08 2022] DELETE /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments/ee4f692b-4bb7-4582-8d08-059778c4c408 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:44:08.468185 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bd882a62-e626-4e63-a4ed-fbf4ccd2d932 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:08.469105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bd882a62-e626-4e63-a4ed-fbf4ccd2d932 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:08.475646 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bd882a62-e626-4e63-a4ed-fbf4ccd2d932 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:08.476082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bd882a62-e626-4e63-a4ed-fbf4ccd2d932 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:08.476830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bd882a62-e626-4e63-a4ed-fbf4ccd2d932 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:08.477252 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bd882a62-e626-4e63-a4ed-fbf4ccd2d932 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:08.481002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:08.508442 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bd882a62-e626-4e63-a4ed-fbf4ccd2d932 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044601 Jun 29 08:44:08.508985 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 422/799] 10.222.0.27 () {60 vars in 1342 bytes} [Wed Jun 29 08:44:08 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:44:09.452208 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6ae5f008-c804-4e6a-80ff-73a91860b097 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:09.452878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6ae5f008-c804-4e6a-80ff-73a91860b097 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:09.460255 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6ae5f008-c804-4e6a-80ff-73a91860b097 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:09.460952 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6ae5f008-c804-4e6a-80ff-73a91860b097 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:09.461730 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6ae5f008-c804-4e6a-80ff-73a91860b097 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:09.462409 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6ae5f008-c804-4e6a-80ff-73a91860b097 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:09.520914 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fd1b7d77-065c-429d-94e0-a23259225554 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:09.524066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fd1b7d77-065c-429d-94e0-a23259225554 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:09.531859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d77-065c-429d-94e0-a23259225554 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:09.532311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d77-065c-429d-94e0-a23259225554 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:09.533122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d77-065c-429d-94e0-a23259225554 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:09.533525 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d77-065c-429d-94e0-a23259225554 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:09.573329 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fd1b7d77-065c-429d-94e0-a23259225554 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056578 Jun 29 08:44:09.574215 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 423/800] 10.222.0.27 () {60 vars in 1342 bytes} [Wed Jun 29 08:44:09 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:44:09.607629 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6ae5f008-c804-4e6a-80ff-73a91860b097 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:09.618725 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6ae5f008-c804-4e6a-80ff-73a91860b097 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.171448 Jun 29 08:44:09.619545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 378/801] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:09 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:10.585142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-169a03f4-9113-47fc-92b4-d6291be2047e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:10.586084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-169a03f4-9113-47fc-92b4-d6291be2047e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:10.597896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-169a03f4-9113-47fc-92b4-d6291be2047e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:10.598366 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-169a03f4-9113-47fc-92b4-d6291be2047e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:10.599807 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-169a03f4-9113-47fc-92b4-d6291be2047e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:10.600251 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-169a03f4-9113-47fc-92b4-d6291be2047e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:10.633712 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-169a03f4-9113-47fc-92b4-d6291be2047e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052682 Jun 29 08:44:10.638767 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 424/802] 10.222.0.27 () {60 vars in 1342 bytes} [Wed Jun 29 08:44:10 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:44:10.638945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b63df1ca-5aae-4b6d-b705-f311bd67d037 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:10.638945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b63df1ca-5aae-4b6d-b705-f311bd67d037 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:10.643036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b63df1ca-5aae-4b6d-b705-f311bd67d037 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:10.643472 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b63df1ca-5aae-4b6d-b705-f311bd67d037 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:10.644428 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b63df1ca-5aae-4b6d-b705-f311bd67d037 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:10.644852 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b63df1ca-5aae-4b6d-b705-f311bd67d037 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:10.850044 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b63df1ca-5aae-4b6d-b705-f311bd67d037 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:10.858015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b63df1ca-5aae-4b6d-b705-f311bd67d037 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.225838 Jun 29 08:44:10.858785 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 379/803] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:10 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:11.648996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1ebdccf1-b076-4cb4-95db-854f751d2c15 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:11.649974 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1ebdccf1-b076-4cb4-95db-854f751d2c15 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:11.657610 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebdccf1-b076-4cb4-95db-854f751d2c15 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:11.658075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebdccf1-b076-4cb4-95db-854f751d2c15 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:11.658900 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebdccf1-b076-4cb4-95db-854f751d2c15 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:11.659352 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebdccf1-b076-4cb4-95db-854f751d2c15 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:11.691636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1ebdccf1-b076-4cb4-95db-854f751d2c15 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048142 Jun 29 08:44:11.692220 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 425/804] 10.222.0.27 () {60 vars in 1342 bytes} [Wed Jun 29 08:44:11 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:11.750418 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d83922dc-f59c-4479-8064-08be2d3c1803 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:11.750945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d83922dc-f59c-4479-8064-08be2d3c1803 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:11.757882 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d83922dc-f59c-4479-8064-08be2d3c1803 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:11.758291 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d83922dc-f59c-4479-8064-08be2d3c1803 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:11.759126 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d83922dc-f59c-4479-8064-08be2d3c1803 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:11.759581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d83922dc-f59c-4479-8064-08be2d3c1803 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:11.784529 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d83922dc-f59c-4479-8064-08be2d3c1803 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:44:11.819388 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:11.867658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d83922dc-f59c-4479-8064-08be2d3c1803 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 204 len: 0 microversion: 2.20 time: 0.120813 Jun 29 08:44:11.868359 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 380/805] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Jun 29 08:44:11 2022] DELETE /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 08:44:11.876971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-38bd7125-1df7-4f09-9b82-d8d3046e6de8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:11.877674 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-38bd7125-1df7-4f09-9b82-d8d3046e6de8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:11.878522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:11.879660 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:11.884234 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-38bd7125-1df7-4f09-9b82-d8d3046e6de8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:11.884686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-38bd7125-1df7-4f09-9b82-d8d3046e6de8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:11.885825 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-38bd7125-1df7-4f09-9b82-d8d3046e6de8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:11.886279 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-38bd7125-1df7-4f09-9b82-d8d3046e6de8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:11.889913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:11.890352 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:11.891152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:11.891578 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:12.081791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-38bd7125-1df7-4f09-9b82-d8d3046e6de8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:12.084656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:12.090732 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-38bd7125-1df7-4f09-9b82-d8d3046e6de8 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.217532 Jun 29 08:44:12.091367 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 381/806] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:11 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:12.093048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:12.094757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:12.095908 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1f26abe7-a31b-4076-8289-ff7c1128bbb8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.223032 Jun 29 08:44:12.096369 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-fbbc56b7-c587-4cea-992f-2cc6b2472003 req-7fb8f264-5ae1-4c21-9951-8db3cf2ff06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9", "name": "network-vif-plugged", "status": "completed", "tag": "f0a90872-a515-411d-a8fc-fb4523dd5f0a"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:12.096615 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 426/807] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:11 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:12.104843 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-fbbc56b7-c587-4cea-992f-2cc6b2472003 req-7fb8f264-5ae1-4c21-9951-8db3cf2ff06d service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:12.105267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-fbbc56b7-c587-4cea-992f-2cc6b2472003 req-7fb8f264-5ae1-4c21-9951-8db3cf2ff06d service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:12.121886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-fbbc56b7-c587-4cea-992f-2cc6b2472003 req-7fb8f264-5ae1-4c21-9951-8db3cf2ff06d service nova] Creating event network-vif-plugged:f0a90872-a515-411d-a8fc-fb4523dd5f0a for instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 on hv-cinder-79760 Jun 29 08:44:12.126910 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-fbbc56b7-c587-4cea-992f-2cc6b2472003 req-7fb8f264-5ae1-4c21-9951-8db3cf2ff06d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033765 Jun 29 08:44:12.127489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 382/808] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:13.093865 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-873d25df-8342-44ed-a5cb-0a3764a7cb17 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:13.094545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-873d25df-8342-44ed-a5cb-0a3764a7cb17 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:13.096717 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:13.097528 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:13.106269 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-873d25df-8342-44ed-a5cb-0a3764a7cb17 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:13.106815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-873d25df-8342-44ed-a5cb-0a3764a7cb17 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:13.107754 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-873d25df-8342-44ed-a5cb-0a3764a7cb17 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:13.109570 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-873d25df-8342-44ed-a5cb-0a3764a7cb17 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:13.109712 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:13.115416 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-fcc7d2a0-efbc-4a6c-af2e-aedbe21dcaf9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:13.116350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fcc7d2a0-efbc-4a6c-af2e-aedbe21dcaf9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:13.123024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fcc7d2a0-efbc-4a6c-af2e-aedbe21dcaf9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:13.123467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fcc7d2a0-efbc-4a6c-af2e-aedbe21dcaf9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:13.124232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fcc7d2a0-efbc-4a6c-af2e-aedbe21dcaf9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:13.124660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fcc7d2a0-efbc-4a6c-af2e-aedbe21dcaf9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:13.135854 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-873d25df-8342-44ed-a5cb-0a3764a7cb17 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:44:13.224151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-873d25df-8342-44ed-a5cb-0a3764a7cb17 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 204 len: 0 microversion: 2.1 time: 0.135160 Jun 29 08:44:13.224747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 427/809] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:44:13 2022] DELETE /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:44:13.230604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:13.231787 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:13.237877 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:13.238318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:13.239122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:13.239720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:13.275880 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-fcc7d2a0-efbc-4a6c-af2e-aedbe21dcaf9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:13.284468 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-fcc7d2a0-efbc-4a6c-af2e-aedbe21dcaf9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.176219 Jun 29 08:44:13.285068 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 383/810] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:13 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:13.290460 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-75854088-285d-4c80-bc8c-391554172a11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:13.291099 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-75854088-285d-4c80-bc8c-391554172a11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:13.297205 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-75854088-285d-4c80-bc8c-391554172a11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:13.297646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-75854088-285d-4c80-bc8c-391554172a11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:13.298418 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-75854088-285d-4c80-bc8c-391554172a11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:13.298880 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-75854088-285d-4c80-bc8c-391554172a11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:13.426605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:13.435460 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:13.436993 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:13.438165 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b50553cb-deaf-4978-9f34-04ef06e513ca tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.211598 Jun 29 08:44:13.438720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 428/811] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:13 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:13.461003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-75854088-285d-4c80-bc8c-391554172a11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:13.469434 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-75854088-285d-4c80-bc8c-391554172a11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1577 microversion: 2.1 time: 0.183405 Jun 29 08:44:13.470005 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 384/812] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:13 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:14.305018 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ccfdbe92-7d68-46e2-a5c1-26e116322eca tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:14.305965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ccfdbe92-7d68-46e2-a5c1-26e116322eca tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:14.317401 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ccfdbe92-7d68-46e2-a5c1-26e116322eca tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:14.318168 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ccfdbe92-7d68-46e2-a5c1-26e116322eca tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:14.319265 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ccfdbe92-7d68-46e2-a5c1-26e116322eca tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:14.319880 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ccfdbe92-7d68-46e2-a5c1-26e116322eca tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:14.457776 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:14.458356 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:14.466480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:14.466966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:14.467736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:14.468160 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:14.471419 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ccfdbe92-7d68-46e2-a5c1-26e116322eca tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:14.479121 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ccfdbe92-7d68-46e2-a5c1-26e116322eca tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.180632 Jun 29 08:44:14.479691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 429/813] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:14 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:14.487485 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ecaa4b6e-c89c-44e3-9459-747c28c77154 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:14.488191 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ecaa4b6e-c89c-44e3-9459-747c28c77154 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:14.494742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ecaa4b6e-c89c-44e3-9459-747c28c77154 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:14.496354 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ecaa4b6e-c89c-44e3-9459-747c28c77154 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:14.497229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ecaa4b6e-c89c-44e3-9459-747c28c77154 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:14.497768 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ecaa4b6e-c89c-44e3-9459-747c28c77154 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:14.681175 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:14.689544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:14.691096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:14.692225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ea3b014b-63b1-4f58-8354-c3e9abab514f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1725 microversion: 2.20 time: 0.238512 Jun 29 08:44:14.692976 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 385/814] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:14 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:14.693685 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ecaa4b6e-c89c-44e3-9459-747c28c77154 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:14.701686 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ecaa4b6e-c89c-44e3-9459-747c28c77154 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1577 microversion: 2.1 time: 0.217831 Jun 29 08:44:14.702239 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 430/815] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:14 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1577 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:15.496642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3a3011f9-e430-4b30-8427-7b45fb971d73 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:15.497262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3a3011f9-e430-4b30-8427-7b45fb971d73 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:15.504087 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3a3011f9-e430-4b30-8427-7b45fb971d73 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:15.504529 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3a3011f9-e430-4b30-8427-7b45fb971d73 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:15.505284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3a3011f9-e430-4b30-8427-7b45fb971d73 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:15.505708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3a3011f9-e430-4b30-8427-7b45fb971d73 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:15.640526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3a3011f9-e430-4b30-8427-7b45fb971d73 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:15.648132 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3a3011f9-e430-4b30-8427-7b45fb971d73 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.155427 Jun 29 08:44:15.648675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 386/816] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:15 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:15.712024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:15.712747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:15.720461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:15.721129 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:15.722089 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:15.722672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:15.724100 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8ddf76af-a8b8-4f68-a156-a47ee1d055ec tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:15.725442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8ddf76af-a8b8-4f68-a156-a47ee1d055ec tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:15.734572 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8ddf76af-a8b8-4f68-a156-a47ee1d055ec tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:15.735357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8ddf76af-a8b8-4f68-a156-a47ee1d055ec tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:15.736516 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8ddf76af-a8b8-4f68-a156-a47ee1d055ec tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:15.737177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8ddf76af-a8b8-4f68-a156-a47ee1d055ec tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:15.793298 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:15.801725 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:15.803337 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:15.804478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-220e99a0-a523-4107-8ee9-1ffffd9e7ae8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1657 microversion: 2.20 time: 0.096788 Jun 29 08:44:15.814896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 431/817] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:15 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1657 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:15.873749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-bd83fc3d-8941-45c9-923e-19f5366eb9c0 req-a6aa7daa-dd96-4f77-8e3d-ea80b055e999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdb4aec-5168-4f28-b336-45afe2620e64", "name": "network-vif-deleted", "tag": "4a2b788b-b706-4ae1-a969-16b817f7a8ad"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:15.883531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-bd83fc3d-8941-45c9-923e-19f5366eb9c0 req-a6aa7daa-dd96-4f77-8e3d-ea80b055e999 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:15.883531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-bd83fc3d-8941-45c9-923e-19f5366eb9c0 req-a6aa7daa-dd96-4f77-8e3d-ea80b055e999 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:15.898663 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-bd83fc3d-8941-45c9-923e-19f5366eb9c0 req-a6aa7daa-dd96-4f77-8e3d-ea80b055e999 service nova] Creating event network-vif-deleted:4a2b788b-b706-4ae1-a969-16b817f7a8ad for instance dcdb4aec-5168-4f28-b336-45afe2620e64 on hv-cinder-79760 Jun 29 08:44:15.901839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8ddf76af-a8b8-4f68-a156-a47ee1d055ec tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:15.908734 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-bd83fc3d-8941-45c9-923e-19f5366eb9c0 req-a6aa7daa-dd96-4f77-8e3d-ea80b055e999 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038896 Jun 29 08:44:15.909539 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 432/818] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:44:15.910034 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8ddf76af-a8b8-4f68-a156-a47ee1d055ec tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1577 microversion: 2.1 time: 0.192132 Jun 29 08:44:15.916702 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 387/819] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:15 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:16.665657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-06eacf2d-2050-4110-bb24-c4ee2de2cd11 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:16.666506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-06eacf2d-2050-4110-bb24-c4ee2de2cd11 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:16.673250 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06eacf2d-2050-4110-bb24-c4ee2de2cd11 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:16.673701 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06eacf2d-2050-4110-bb24-c4ee2de2cd11 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:16.674511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06eacf2d-2050-4110-bb24-c4ee2de2cd11 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:16.674966 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-06eacf2d-2050-4110-bb24-c4ee2de2cd11 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:16.812047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-06eacf2d-2050-4110-bb24-c4ee2de2cd11 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:16.821416 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-06eacf2d-2050-4110-bb24-c4ee2de2cd11 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1367 microversion: 2.1 time: 0.159334 Jun 29 08:44:16.821416 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 433/820] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:16 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:16.824217 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:16.824672 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:16.830839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:16.831277 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:16.832088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:16.832513 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:16.864295 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:16.864729 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:16.865177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lazy-loading 'fault' on Instance uuid dcdb4aec-5168-4f28-b336-45afe2620e64 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:44:16.911241 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:16.921040 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:16.923478 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:16.924709 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1a612da0-798b-4ece-be3e-21ec29bb6ecf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 200 len: 1372 microversion: 2.20 time: 0.105989 Jun 29 08:44:16.926025 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 388/821] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:16 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:44:16.931175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1e0b7a23-32eb-47ba-9d45-fe796a87b593 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:16.931870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1e0b7a23-32eb-47ba-9d45-fe796a87b593 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:16.938765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e0b7a23-32eb-47ba-9d45-fe796a87b593 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:16.939855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e0b7a23-32eb-47ba-9d45-fe796a87b593 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:16.940506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e0b7a23-32eb-47ba-9d45-fe796a87b593 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:16.941177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1e0b7a23-32eb-47ba-9d45-fe796a87b593 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:17.105290 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1e0b7a23-32eb-47ba-9d45-fe796a87b593 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:17.113516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1e0b7a23-32eb-47ba-9d45-fe796a87b593 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1577 microversion: 2.1 time: 0.189940 Jun 29 08:44:17.114513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 434/822] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:16 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:44:17.838259 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5b4443d4-afc6-4ff2-9774-8c33a74e07a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:17.838923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5b4443d4-afc6-4ff2-9774-8c33a74e07a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:17.841641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:17.849041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b4443d4-afc6-4ff2-9774-8c33a74e07a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:17.849453 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b4443d4-afc6-4ff2-9774-8c33a74e07a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:17.850322 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b4443d4-afc6-4ff2-9774-8c33a74e07a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:17.850956 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5b4443d4-afc6-4ff2-9774-8c33a74e07a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:17.943713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:17.944360 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:17.948065 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:17.951782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:17.952314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:17.953268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:17.953761 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:17.994838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] HTTP exception thrown: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Request method failure captured: Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 HTTP/1.1 Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7JzyS0A90bJs40JO9rP6Jdha-y5pzziLVUX-LwPQgIc9FKtSyCVmH_OqiJn62TvbwkiWwUJ8v03ehzXbQQmlfmqo_pvELEaZZ8yXKL9sh9rjOp6ohtKVzoWsnQ2tpBXqfpR3Ism9vtuAq5ItfEtehmAcNbHl4s-fy1wdIXyH6rBbA Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:44:17.997011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3addc279ffb4a49b379a938b1fbed3c"}]}] Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 37d6c5d1f76445499566472213f13e3a Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:44:17.998466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'dcdb4aec-5168-4f28-b336-45afe2620e64'} Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:44:17.999279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:44:18.000509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:18.003247 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Returning 404 to user: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:44:18.004203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0ee0a93a-f1d2-4e7d-b56f-68c489615b87 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 404 len: 111 microversion: 2.20 time: 0.064580 Jun 29 08:44:18.004843 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 435/823] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:17 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:44:18.009939 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-9930565f-24d3-4ddd-bfdc-672ef5c04e01 req-b02108d5-89a0-4e57-9312-6d8c0611e962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d86a45-eb3d-4489-aa2e-c9be196427ee", "name": "network-vif-deleted", "tag": "2fca60b0-747a-4269-9d67-e79a476ee76a"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:18.021186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-9930565f-24d3-4ddd-bfdc-672ef5c04e01 req-b02108d5-89a0-4e57-9312-6d8c0611e962 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:18.022135 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-9930565f-24d3-4ddd-bfdc-672ef5c04e01 req-b02108d5-89a0-4e57-9312-6d8c0611e962 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:18.041856 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-9930565f-24d3-4ddd-bfdc-672ef5c04e01 req-b02108d5-89a0-4e57-9312-6d8c0611e962 service nova] Creating event network-vif-deleted:2fca60b0-747a-4269-9d67-e79a476ee76a for instance f3d86a45-eb3d-4489-aa2e-c9be196427ee on hv-cinder-79760 Jun 29 08:44:18.047078 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-9930565f-24d3-4ddd-bfdc-672ef5c04e01 req-b02108d5-89a0-4e57-9312-6d8c0611e962 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040618 Jun 29 08:44:18.047995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 436/824] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:18.056462 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1b1f04a7-3512-4e3a-9738-2e718874b4f4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '.version_select at 0x7fade4223160>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:18.081740 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1b1f04a7-3512-4e3a-9738-2e718874b4f4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853778363" status: 204 len: 0 microversion: 2.20 time: 0.029807 Jun 29 08:44:18.082736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 437/825] 10.222.0.27 () {60 vars in 1261 bytes} [Wed Jun 29 08:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853778363 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 08:44:18.127129 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5b4443d4-afc6-4ff2-9774-8c33a74e07a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:18.134151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c1eee95c-f6d6-4aa1-b30d-b464ca790e78 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:18.134896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c1eee95c-f6d6-4aa1-b30d-b464ca790e78 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:18.145757 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5b4443d4-afc6-4ff2-9774-8c33a74e07a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1557 microversion: 2.1 time: 0.311753 Jun 29 08:44:18.146712 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 389/826] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:17 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1557 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:18.148875 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1eee95c-f6d6-4aa1-b30d-b464ca790e78 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:18.149478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1eee95c-f6d6-4aa1-b30d-b464ca790e78 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:18.150415 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1eee95c-f6d6-4aa1-b30d-b464ca790e78 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:18.151116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1eee95c-f6d6-4aa1-b30d-b464ca790e78 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:18.166527 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-45767e18-ca13-411d-ac25-e93e81034267 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:18.167058 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-45767e18-ca13-411d-ac25-e93e81034267 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:18.184747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-45767e18-ca13-411d-ac25-e93e81034267 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:18.185193 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-45767e18-ca13-411d-ac25-e93e81034267 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:18.186030 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-45767e18-ca13-411d-ac25-e93e81034267 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:18.186454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-45767e18-ca13-411d-ac25-e93e81034267 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:18.313249 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c1eee95c-f6d6-4aa1-b30d-b464ca790e78 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:18.327069 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-45767e18-ca13-411d-ac25-e93e81034267 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164543 Jun 29 08:44:18.327791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 390/827] 10.222.0.27 () {58 vars in 1274 bytes} [Wed Jun 29 08:44:18 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:44:18.330434 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c1eee95c-f6d6-4aa1-b30d-b464ca790e78 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 200 len: 1225 microversion: 2.1 time: 0.199197 Jun 29 08:44:18.340030 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 438/828] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:18 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 1225 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:18.936723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e107c513-ed02-4dfc-a7a8-056de4b88dc8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'create', calling method: .version_select at 0x7fade4107e50>, body: {"keypair": {"name": "tempest-keypair-1569604800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhRLJwNQIGP9+UsPVa5flTljzfuLi+In2Cb7TP+Bp6SQSER6+sqU4dVmP3Cx+akSPER+Pii31XFhMclmf5DBjWww6hK3dHgCFGsUJYoy6WJoo2E1Fky102zNIiQ+5vcew=="}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:18.952908 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-e107c513-ed02-4dfc-a7a8-056de4b88dc8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Getting quotas for project c3addc279ffb4a49b379a938b1fbed3c. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:44:18.957693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-e107c513-ed02-4dfc-a7a8-056de4b88dc8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Getting quotas for user 37d6c5d1f76445499566472213f13e3a and project c3addc279ffb4a49b379a938b1fbed3c. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:44:18.987210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e107c513-ed02-4dfc-a7a8-056de4b88dc8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.058357 Jun 29 08:44:18.988402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 391/829] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Jun 29 08:44:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 08:44:19.347650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:19.348460 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:19.355313 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:19.355960 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:19.356975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:19.357333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:19.371535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] HTTP exception thrown: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Request method failure captured: Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee HTTP/1.1 Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA-75A6968hpQMC_Kzsb8ZZkr6AD2PjEFlEJjtjpJOJgcHd87N2Sbxr10G2crXkbgz2X8FVzaVS88kWHHWetv41ZQ3fWoByNQXs2EpFke5V-xJtKo6rrQyjG-wC9iWaetD0VhK_FAgOL7q2FtOCt1OEJ-NCvKHNjRHDH9SM8t4bl3qs Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:44:19.373303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa6da3e4a87442299d21f3b55dfe3e9f"}]}] Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 1b2337595cbb40608d6bc485889d8bc6 Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:44:19.374782 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'f3d86a45-eb3d-4489-aa2e-c9be196427ee'} Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:44:19.376764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:44:19.377901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:19.378975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Returning 404 to user: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:44:19.378975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1f28d300-e463-4cfa-abfb-dda5207fd3dd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jun 29 08:44:19.378975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 439/830] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:19 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:44:19.489813 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1569139419", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1732324740", "security_groups": [{"name": "tempest-secgroup-smoke-633675277"}], "block_device_mapping_v2": [{"uuid": "34923cc0-acae-4fee-b890-8b033059c577", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "95cdc108-572d-40ee-b588-3458605e5b77"}]}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:19.931188 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] validate_networks() for [('95cdc108-572d-40ee-b588-3458605e5b77', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:44:20.063421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-3dfd79e7-e872-4c07-8b10-f734e3c2cf1a req-e6ef96cd-2e28-445d-896f-7c70102e536d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9", "tag": "f0a90872-a515-411d-a8fc-fb4523dd5f0a"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:20.075690 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-3dfd79e7-e872-4c07-8b10-f734e3c2cf1a req-e6ef96cd-2e28-445d-896f-7c70102e536d service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:20.076556 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-3dfd79e7-e872-4c07-8b10-f734e3c2cf1a req-e6ef96cd-2e28-445d-896f-7c70102e536d service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:20.089479 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-3dfd79e7-e872-4c07-8b10-f734e3c2cf1a req-e6ef96cd-2e28-445d-896f-7c70102e536d service nova] Creating event network-changed:f0a90872-a515-411d-a8fc-fb4523dd5f0a for instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 on hv-cinder-79760 Jun 29 08:44:20.095004 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-3dfd79e7-e872-4c07-8b10-f734e3c2cf1a req-e6ef96cd-2e28-445d-896f-7c70102e536d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035994 Jun 29 08:44:20.095880 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 440/831] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:20.605048 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:44:20.605646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:44:20.606218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:44:20.606824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:44:20.607467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:44:20.620904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:20.621371 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:20.622133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:20.622536 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:20.642377 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Getting quotas for project fa6da3e4a87442299d21f3b55dfe3e9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:44:20.647896 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Getting quotas for user 1b2337595cbb40608d6bc485889d8bc6 and project fa6da3e4a87442299d21f3b55dfe3e9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:44:20.720217 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:44:20.722601 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='34923cc0-acae-4fee-b890-8b033059c577',volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:44:20.887838 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-27c4e578-d787-4de6-b155-16a2d52a8ffe tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.402346 Jun 29 08:44:20.888783 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 392/832] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:44:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:44:20.900340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c65a0581-0e2c-4c7e-b54b-8d876bc4a2be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:20.901175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c65a0581-0e2c-4c7e-b54b-8d876bc4a2be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:20.991295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c65a0581-0e2c-4c7e-b54b-8d876bc4a2be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:21.000876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c65a0581-0e2c-4c7e-b54b-8d876bc4a2be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1095 microversion: 2.1 time: 0.105030 Jun 29 08:44:21.001900 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 441/833] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:20 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1095 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:21.124327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1729614816", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a66168-0837-4bad-a2b8-8a5ff845378e"}], "security_groups": [{"name": "tempest-securitygroup--142125764"}], "key_name": "tempest-keypair-1569604800", "user_data": "}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:21.231946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] validate_networks() for [('36a66168-0837-4bad-a2b8-8a5ff845378e', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:44:21.617304 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:44:21.617907 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:44:21.618169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:44:21.618576 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:44:21.619015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:44:21.628247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:21.628684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:21.629457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:21.629882 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:21.646540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Getting quotas for project c3addc279ffb4a49b379a938b1fbed3c. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:44:21.650199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Getting quotas for user 37d6c5d1f76445499566472213f13e3a and project c3addc279ffb4a49b379a938b1fbed3c. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:44:21.661041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:44:21.663382 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:44:21.709034 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e8844824-7208-430e-ae7c-ea6720d5fc8f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.589442 Jun 29 08:44:21.709688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 393/834] 10.222.0.27 () {62 vars in 1187 bytes} [Wed Jun 29 08:44:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 29 08:44:21.720083 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9969e721-8444-4e66-9434-e4bede892c49 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:21.720613 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9969e721-8444-4e66-9434-e4bede892c49 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:21.774035 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9969e721-8444-4e66-9434-e4bede892c49 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:21.783226 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9969e721-8444-4e66-9434-e4bede892c49 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:21.784760 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9969e721-8444-4e66-9434-e4bede892c49 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:21.785859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9969e721-8444-4e66-9434-e4bede892c49 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1282 microversion: 2.20 time: 0.069747 Jun 29 08:44:21.786406 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 442/835] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:21 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:44:22.018641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a3021014-f9fb-4485-8d6b-e96ce68fdc41 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:22.019326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a3021014-f9fb-4485-8d6b-e96ce68fdc41 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:22.026730 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a3021014-f9fb-4485-8d6b-e96ce68fdc41 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:22.027579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a3021014-f9fb-4485-8d6b-e96ce68fdc41 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:22.028711 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a3021014-f9fb-4485-8d6b-e96ce68fdc41 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:22.029863 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a3021014-f9fb-4485-8d6b-e96ce68fdc41 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:22.097784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a3021014-f9fb-4485-8d6b-e96ce68fdc41 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:22.106090 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a3021014-f9fb-4485-8d6b-e96ce68fdc41 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1211 microversion: 2.1 time: 0.091337 Jun 29 08:44:22.107282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 394/836] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:22 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:22.806449 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:22.809237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:22.818935 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:22.819393 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:22.824793 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:22.832038 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:22.873600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:22.972165 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:22.985808 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:22.987338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:22.988449 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-23c05836-b698-437a-ade0-66849a80843d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1342 microversion: 2.20 time: 0.187572 Jun 29 08:44:22.991124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 443/837] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:22 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1342 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:23.124397 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a702c3af-f314-4a73-bf2d-5830e1fbe614 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:23.125000 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a702c3af-f314-4a73-bf2d-5830e1fbe614 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:23.131913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a702c3af-f314-4a73-bf2d-5830e1fbe614 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:23.132352 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a702c3af-f314-4a73-bf2d-5830e1fbe614 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:23.133115 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a702c3af-f314-4a73-bf2d-5830e1fbe614 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:23.133540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a702c3af-f314-4a73-bf2d-5830e1fbe614 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:23.369634 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a702c3af-f314-4a73-bf2d-5830e1fbe614 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:23.379146 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a702c3af-f314-4a73-bf2d-5830e1fbe614 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.258215 Jun 29 08:44:23.390980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 395/838] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:23 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:23.456877 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-42ed3d9d-31ea-4311-91d7-df453d62e964 req-37977dda-f3f1-421b-8af5-5c24ccc60b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6076488f-0093-4b7c-a6a9-aabd1bc916be", "tag": "81acf11d-e234-4a0d-b1b0-7ac02df25f6d"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:23.476270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-42ed3d9d-31ea-4311-91d7-df453d62e964 req-37977dda-f3f1-421b-8af5-5c24ccc60b12 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:23.477783 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-42ed3d9d-31ea-4311-91d7-df453d62e964 req-37977dda-f3f1-421b-8af5-5c24ccc60b12 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:23.493439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-42ed3d9d-31ea-4311-91d7-df453d62e964 req-37977dda-f3f1-421b-8af5-5c24ccc60b12 service nova] Creating event network-changed:81acf11d-e234-4a0d-b1b0-7ac02df25f6d for instance 6076488f-0093-4b7c-a6a9-aabd1bc916be on hv-cinder-79760 Jun 29 08:44:23.499053 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-42ed3d9d-31ea-4311-91d7-df453d62e964 req-37977dda-f3f1-421b-8af5-5c24ccc60b12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048026 Jun 29 08:44:23.500248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 444/839] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:24.009516 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:24.010124 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:24.016324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:24.016755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:24.017519 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:24.017958 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:24.243071 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:24.251554 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:24.253105 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:24.254226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d4faac65-f64f-402c-9ffc-b1993d636f2e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.249010 Jun 29 08:44:24.254825 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 396/840] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:24 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:24.398726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-70355c46-498e-4a07-a615-691b0da30a5e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:24.405990 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-70355c46-498e-4a07-a615-691b0da30a5e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:24.412827 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70355c46-498e-4a07-a615-691b0da30a5e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:24.413428 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70355c46-498e-4a07-a615-691b0da30a5e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:24.414174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70355c46-498e-4a07-a615-691b0da30a5e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:24.414592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-70355c46-498e-4a07-a615-691b0da30a5e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:24.621656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-70355c46-498e-4a07-a615-691b0da30a5e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:24.630227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-70355c46-498e-4a07-a615-691b0da30a5e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.235993 Jun 29 08:44:24.630936 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 445/841] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:24 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:24.706215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-60ca296c-ddef-4c9e-8009-17bf624acf54 req-48a3247a-4176-481b-b92a-771d8717f679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f64cb6c-8320-480e-b79c-bb55a51513b8", "tag": "0a7a70f1-09de-40ce-b9fe-437390cf5dab"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:24.716437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-60ca296c-ddef-4c9e-8009-17bf624acf54 req-48a3247a-4176-481b-b92a-771d8717f679 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:24.716887 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-60ca296c-ddef-4c9e-8009-17bf624acf54 req-48a3247a-4176-481b-b92a-771d8717f679 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:24.736780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-60ca296c-ddef-4c9e-8009-17bf624acf54 req-48a3247a-4176-481b-b92a-771d8717f679 service nova] Creating event network-changed:0a7a70f1-09de-40ce-b9fe-437390cf5dab for instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 on hv-cinder-79760 Jun 29 08:44:24.742217 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-60ca296c-ddef-4c9e-8009-17bf624acf54 req-48a3247a-4176-481b-b92a-771d8717f679 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039727 Jun 29 08:44:24.742803 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 397/842] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:25.270066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b985f52-6fc3-4471-b00b-48fa14d6f67b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:25.270558 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0b985f52-6fc3-4471-b00b-48fa14d6f67b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:25.274743 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:25.275469 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:25.276882 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b985f52-6fc3-4471-b00b-48fa14d6f67b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:25.277322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b985f52-6fc3-4471-b00b-48fa14d6f67b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:25.278071 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b985f52-6fc3-4471-b00b-48fa14d6f67b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:25.278494 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b985f52-6fc3-4471-b00b-48fa14d6f67b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:25.282480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:25.282957 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:25.283733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:25.284166 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:25.367010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-0b985f52-6fc3-4471-b00b-48fa14d6f67b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lazy-loading 'services' on Instance uuid 86b2d8b0-44c2-4e85-9d24-0c27d7164edf {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:44:25.421884 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:25.437575 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:25.439166 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:25.440869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3a18ef91-321a-42a9-9fe8-af45076bdcc0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.171154 Jun 29 08:44:25.451624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 398/843] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:25 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:25.464498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0b985f52-6fc3-4471-b00b-48fa14d6f67b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments/5c79714c-f219-4185-ab77-528f697d15b4" status: 202 len: 0 microversion: 2.1 time: 0.198182 Jun 29 08:44:25.465762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 446/844] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:44:25 2022] DELETE /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments/5c79714c-f219-4185-ab77-528f697d15b4 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:44:25.481123 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7d9ae05b-8705-4172-a2fe-6c8b8645bdba tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:25.482313 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7d9ae05b-8705-4172-a2fe-6c8b8645bdba tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:25.491692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d9ae05b-8705-4172-a2fe-6c8b8645bdba tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:25.492131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d9ae05b-8705-4172-a2fe-6c8b8645bdba tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:25.492885 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d9ae05b-8705-4172-a2fe-6c8b8645bdba tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:25.493349 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d9ae05b-8705-4172-a2fe-6c8b8645bdba tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:25.524072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7d9ae05b-8705-4172-a2fe-6c8b8645bdba tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048506 Jun 29 08:44:25.525198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 399/845] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:44:25 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:25.648031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f090a1aa-fe1e-47c3-a12c-ee4afa079215 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:25.648866 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f090a1aa-fe1e-47c3-a12c-ee4afa079215 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:25.655723 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f090a1aa-fe1e-47c3-a12c-ee4afa079215 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:25.656261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f090a1aa-fe1e-47c3-a12c-ee4afa079215 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:25.657115 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f090a1aa-fe1e-47c3-a12c-ee4afa079215 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:25.657609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f090a1aa-fe1e-47c3-a12c-ee4afa079215 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:25.796268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f090a1aa-fe1e-47c3-a12c-ee4afa079215 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:25.804490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f090a1aa-fe1e-47c3-a12c-ee4afa079215 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.160792 Jun 29 08:44:25.805112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 447/846] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:25 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:26.459269 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:26.461037 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:26.468717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:26.469633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:26.470867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:26.471380 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:26.500248 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:26.538790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1b65817b-0692-4d5e-abca-151a5285d78b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:26.540500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1b65817b-0692-4d5e-abca-151a5285d78b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:26.548401 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b65817b-0692-4d5e-abca-151a5285d78b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:26.549105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b65817b-0692-4d5e-abca-151a5285d78b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:26.550025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b65817b-0692-4d5e-abca-151a5285d78b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:26.550594 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b65817b-0692-4d5e-abca-151a5285d78b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:26.587225 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1b65817b-0692-4d5e-abca-151a5285d78b tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052830 Jun 29 08:44:26.587881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 448/847] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:44:26 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:26.648489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:26.656679 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:26.658159 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:26.659272 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a951d2f4-2cb9-496b-b3c7-098618e3de0e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.204177 Jun 29 08:44:26.659823 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 400/848] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:26 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:26.821360 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e3d3f326-e1c9-4ece-b84b-b7ee1b429e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:26.821968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e3d3f326-e1c9-4ece-b84b-b7ee1b429e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:26.828501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e3d3f326-e1c9-4ece-b84b-b7ee1b429e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:26.828944 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e3d3f326-e1c9-4ece-b84b-b7ee1b429e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:26.829698 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e3d3f326-e1c9-4ece-b84b-b7ee1b429e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:26.830122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e3d3f326-e1c9-4ece-b84b-b7ee1b429e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:26.978853 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e3d3f326-e1c9-4ece-b84b-b7ee1b429e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:26.986822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e3d3f326-e1c9-4ece-b84b-b7ee1b429e89 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.169461 Jun 29 08:44:26.987390 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 449/849] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:26 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:27.602134 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4f7d04fe-eee1-4a0c-9c1b-6d162224e3ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:27.603091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4f7d04fe-eee1-4a0c-9c1b-6d162224e3ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:27.610009 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4f7d04fe-eee1-4a0c-9c1b-6d162224e3ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:27.610456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4f7d04fe-eee1-4a0c-9c1b-6d162224e3ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:27.611259 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4f7d04fe-eee1-4a0c-9c1b-6d162224e3ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:27.611694 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4f7d04fe-eee1-4a0c-9c1b-6d162224e3ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:27.641674 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4f7d04fe-eee1-4a0c-9c1b-6d162224e3ab tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044885 Jun 29 08:44:27.642215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 401/850] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:44:27 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:44:27.677010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:27.677633 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:27.684757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:27.685219 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:27.685989 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:27.686415 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:27.710374 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a62effbf-0223-4ab5-b6e7-483d30aa0d80 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:27.710903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a62effbf-0223-4ab5-b6e7-483d30aa0d80 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:27.717504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a62effbf-0223-4ab5-b6e7-483d30aa0d80 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:27.717881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a62effbf-0223-4ab5-b6e7-483d30aa0d80 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:27.718642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a62effbf-0223-4ab5-b6e7-483d30aa0d80 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:27.719112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a62effbf-0223-4ab5-b6e7-483d30aa0d80 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:27.744889 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a62effbf-0223-4ab5-b6e7-483d30aa0d80 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:44:27.818778 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:27.827441 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:27.828023 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a62effbf-0223-4ab5-b6e7-483d30aa0d80 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 204 len: 0 microversion: 2.1 time: 0.121264 Jun 29 08:44:27.828694 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 402/851] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:44:27 2022] DELETE /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 08:44:27.829067 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:27.830214 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8105389f-1a51-4f4d-8943-0f196b963c4f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.157147 Jun 29 08:44:27.830779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 450/852] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:27 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:27.837173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-41b2503d-189c-4c1c-8395-c3a2732cce3a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:27.837989 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-41b2503d-189c-4c1c-8395-c3a2732cce3a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:27.844369 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41b2503d-189c-4c1c-8395-c3a2732cce3a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:27.844811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41b2503d-189c-4c1c-8395-c3a2732cce3a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:27.845563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41b2503d-189c-4c1c-8395-c3a2732cce3a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:27.845981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41b2503d-189c-4c1c-8395-c3a2732cce3a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:27.992281 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-41b2503d-189c-4c1c-8395-c3a2732cce3a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:27.999991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-41b2503d-189c-4c1c-8395-c3a2732cce3a tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1688 microversion: 2.1 time: 0.166855 Jun 29 08:44:28.000530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 403/853] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:27 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:44:28.004154 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fa947a79-7343-4dc4-b2c6-bb48711dcb11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:28.004759 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fa947a79-7343-4dc4-b2c6-bb48711dcb11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:28.010965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa947a79-7343-4dc4-b2c6-bb48711dcb11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:28.011408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa947a79-7343-4dc4-b2c6-bb48711dcb11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:28.012180 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa947a79-7343-4dc4-b2c6-bb48711dcb11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:28.012591 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa947a79-7343-4dc4-b2c6-bb48711dcb11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:28.153206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fa947a79-7343-4dc4-b2c6-bb48711dcb11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:28.161169 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fa947a79-7343-4dc4-b2c6-bb48711dcb11 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.161113 Jun 29 08:44:28.161709 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 451/854] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:27 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:28.853250 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:28.854352 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:28.865529 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:28.865990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:28.866757 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:28.867182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:29.013070 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:29.017305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ca137908-7f16-4a3b-9119-5b6c91ca63ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:29.017912 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ca137908-7f16-4a3b-9119-5b6c91ca63ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:29.021738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:29.023273 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:29.024380 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d6f24ce2-b69e-45e4-b491-68a0376cf671 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.178221 Jun 29 08:44:29.024945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 404/855] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:28 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:29.025084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca137908-7f16-4a3b-9119-5b6c91ca63ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:29.025430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca137908-7f16-4a3b-9119-5b6c91ca63ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:29.026202 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca137908-7f16-4a3b-9119-5b6c91ca63ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:29.026626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca137908-7f16-4a3b-9119-5b6c91ca63ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:29.163866 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ca137908-7f16-4a3b-9119-5b6c91ca63ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:29.172064 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ca137908-7f16-4a3b-9119-5b6c91ca63ed tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1688 microversion: 2.1 time: 0.158619 Jun 29 08:44:29.172638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 452/856] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:29 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:44:29.178440 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a9fdf4e2-f8dc-447d-aaba-dde4abb65716 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:29.178984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a9fdf4e2-f8dc-447d-aaba-dde4abb65716 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:29.185084 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a9fdf4e2-f8dc-447d-aaba-dde4abb65716 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:29.185523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a9fdf4e2-f8dc-447d-aaba-dde4abb65716 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:29.186278 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a9fdf4e2-f8dc-447d-aaba-dde4abb65716 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:29.186729 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a9fdf4e2-f8dc-447d-aaba-dde4abb65716 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:29.387684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a9fdf4e2-f8dc-447d-aaba-dde4abb65716 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:29.395296 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a9fdf4e2-f8dc-447d-aaba-dde4abb65716 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.221001 Jun 29 08:44:29.395854 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 405/857] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:29 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:30.045156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:30.046327 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:30.057749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:30.058472 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:30.059772 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:30.060471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:30.189956 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4bfb7c55-a612-4e1e-b4e4-fc89c8e700e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:30.190508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4bfb7c55-a612-4e1e-b4e4-fc89c8e700e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:30.197524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4bfb7c55-a612-4e1e-b4e4-fc89c8e700e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:30.197971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4bfb7c55-a612-4e1e-b4e4-fc89c8e700e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:30.198757 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4bfb7c55-a612-4e1e-b4e4-fc89c8e700e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:30.199214 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4bfb7c55-a612-4e1e-b4e4-fc89c8e700e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:30.202824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:30.211638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:30.213162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:30.214251 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c24e90f8-5a3d-4cf1-a37b-e2afbda97a4b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.176285 Jun 29 08:44:30.214812 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 453/858] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:30 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:30.343597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4bfb7c55-a612-4e1e-b4e4-fc89c8e700e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:30.355765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4bfb7c55-a612-4e1e-b4e4-fc89c8e700e1 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1688 microversion: 2.1 time: 0.169519 Jun 29 08:44:30.356509 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 406/859] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:30 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:30.416744 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8e11c153-8323-40cb-aef0-c77c12d6d354 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:30.417370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8e11c153-8323-40cb-aef0-c77c12d6d354 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:30.423785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e11c153-8323-40cb-aef0-c77c12d6d354 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:30.424010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e11c153-8323-40cb-aef0-c77c12d6d354 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:30.424749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e11c153-8323-40cb-aef0-c77c12d6d354 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:30.425169 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e11c153-8323-40cb-aef0-c77c12d6d354 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:30.839230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8e11c153-8323-40cb-aef0-c77c12d6d354 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:30.850732 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8e11c153-8323-40cb-aef0-c77c12d6d354 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.437722 Jun 29 08:44:30.851735 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 454/860] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:30 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:31.233032 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:31.233658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:31.248137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:31.248498 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:31.249316 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:31.249911 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:31.375171 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-90e15013-1ed9-4b02-8070-0efd7a329840 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:31.375755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-90e15013-1ed9-4b02-8070-0efd7a329840 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:31.382666 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90e15013-1ed9-4b02-8070-0efd7a329840 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:31.383146 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90e15013-1ed9-4b02-8070-0efd7a329840 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:31.383903 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90e15013-1ed9-4b02-8070-0efd7a329840 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:31.384326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90e15013-1ed9-4b02-8070-0efd7a329840 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:31.389672 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:31.397891 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:31.399373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:31.400487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0d970f6d-a47e-4a9a-a0c6-024c3bc367e3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.171469 Jun 29 08:44:31.401043 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 407/861] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:31 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:31.523015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-90e15013-1ed9-4b02-8070-0efd7a329840 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:31.530596 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-90e15013-1ed9-4b02-8070-0efd7a329840 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1688 microversion: 2.1 time: 0.159514 Jun 29 08:44:31.531230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 455/862] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:31 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:44:31.853140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-3e78ac58-5cfd-43ab-81bb-403718e43ff3 req-b8a5ed58-7aa9-4f6c-803c-9adfa4296dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f64cb6c-8320-480e-b79c-bb55a51513b8", "name": "network-vif-plugged", "status": "completed", "tag": "0a7a70f1-09de-40ce-b9fe-437390cf5dab"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:31.857117 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=4 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:31.857426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=16 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:31.864296 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-3e78ac58-5cfd-43ab-81bb-403718e43ff3 req-b8a5ed58-7aa9-4f6c-803c-9adfa4296dcb service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:31.864776 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-3e78ac58-5cfd-43ab-81bb-403718e43ff3 req-b8a5ed58-7aa9-4f6c-803c-9adfa4296dcb service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:31.870166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-00895e39-bede-45de-9217-3c707ceb96ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:31.870803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-00895e39-bede-45de-9217-3c707ceb96ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:31.873898 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=4 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:31.877180 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-3e78ac58-5cfd-43ab-81bb-403718e43ff3 req-b8a5ed58-7aa9-4f6c-803c-9adfa4296dcb service nova] Creating event network-vif-plugged:0a7a70f1-09de-40ce-b9fe-437390cf5dab for instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 on hv-cinder-79760 Jun 29 08:44:31.877643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-00895e39-bede-45de-9217-3c707ceb96ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:31.878082 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-00895e39-bede-45de-9217-3c707ceb96ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:31.879013 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-00895e39-bede-45de-9217-3c707ceb96ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:31.879436 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-00895e39-bede-45de-9217-3c707ceb96ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:31.882150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-3e78ac58-5cfd-43ab-81bb-403718e43ff3 req-b8a5ed58-7aa9-4f6c-803c-9adfa4296dcb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033153 Jun 29 08:44:31.882953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 408/863] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:32.021592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-00895e39-bede-45de-9217-3c707ceb96ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:32.029258 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-00895e39-bede-45de-9217-3c707ceb96ac tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.164813 Jun 29 08:44:32.029830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 456/864] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:31 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:32.424540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:32.425719 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:32.436579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:32.437311 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:32.438559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:32.439418 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:32.548156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1000e2d7-89f4-4226-88cf-b942bd717f9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:32.548746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1000e2d7-89f4-4226-88cf-b942bd717f9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:32.555969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1000e2d7-89f4-4226-88cf-b942bd717f9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:32.556498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1000e2d7-89f4-4226-88cf-b942bd717f9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:32.557316 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1000e2d7-89f4-4226-88cf-b942bd717f9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:32.557803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1000e2d7-89f4-4226-88cf-b942bd717f9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:32.580260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:32.588773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:32.590797 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:32.592017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1e3526f4-0f94-4104-ab35-1cd4b813e7e8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.175454 Jun 29 08:44:32.592655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 409/865] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:32 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:32.685367 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1000e2d7-89f4-4226-88cf-b942bd717f9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:32.694000 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1000e2d7-89f4-4226-88cf-b942bd717f9f tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1688 microversion: 2.1 time: 0.149583 Jun 29 08:44:32.694670 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 457/866] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:32 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:44:33.050454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8b415b14-ff20-4249-8e2c-ce04a3c18fe0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:33.051492 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8b415b14-ff20-4249-8e2c-ce04a3c18fe0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:33.062043 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8b415b14-ff20-4249-8e2c-ce04a3c18fe0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:33.062776 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8b415b14-ff20-4249-8e2c-ce04a3c18fe0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:33.064064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8b415b14-ff20-4249-8e2c-ce04a3c18fe0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:33.064765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8b415b14-ff20-4249-8e2c-ce04a3c18fe0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:33.200391 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8b415b14-ff20-4249-8e2c-ce04a3c18fe0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:33.210520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8b415b14-ff20-4249-8e2c-ce04a3c18fe0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.166563 Jun 29 08:44:33.211086 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 410/867] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:33 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:33.614454 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:33.615594 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:33.626839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:33.627600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:33.628945 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:33.629663 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:33.711723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f57aea62-a9ef-41cb-a047-917e0c468fd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:33.712487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f57aea62-a9ef-41cb-a047-917e0c468fd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:33.720656 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f57aea62-a9ef-41cb-a047-917e0c468fd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:33.721141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f57aea62-a9ef-41cb-a047-917e0c468fd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:33.722011 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f57aea62-a9ef-41cb-a047-917e0c468fd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:33.722595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f57aea62-a9ef-41cb-a047-917e0c468fd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:33.778445 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:33.791678 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:33.793394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:33.795164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bbaa3c2b-22b9-4158-b89b-62271c273c11 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.186754 Jun 29 08:44:33.796098 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 458/868] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:33 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:33.874225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f57aea62-a9ef-41cb-a047-917e0c468fd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:33.884390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f57aea62-a9ef-41cb-a047-917e0c468fd0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1688 microversion: 2.1 time: 0.176639 Jun 29 08:44:33.884955 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 411/869] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:33 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:34.228054 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-885fab6c-67df-42a5-8d0c-df37be80793f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:34.228660 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-885fab6c-67df-42a5-8d0c-df37be80793f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:34.235070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-885fab6c-67df-42a5-8d0c-df37be80793f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:34.235498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-885fab6c-67df-42a5-8d0c-df37be80793f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:34.236263 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-885fab6c-67df-42a5-8d0c-df37be80793f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:34.236689 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-885fab6c-67df-42a5-8d0c-df37be80793f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:34.408886 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-885fab6c-67df-42a5-8d0c-df37be80793f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:34.419350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-885fab6c-67df-42a5-8d0c-df37be80793f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.194991 Jun 29 08:44:34.419896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 459/870] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:34 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:34.813776 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:34.814402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:34.821020 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:34.821459 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:34.822206 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:34.822631 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:34.902010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-08c812a9-326b-4fb0-a31c-ad949ca366a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:34.902781 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-08c812a9-326b-4fb0-a31c-ad949ca366a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:34.910072 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08c812a9-326b-4fb0-a31c-ad949ca366a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:34.910629 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08c812a9-326b-4fb0-a31c-ad949ca366a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:34.911614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08c812a9-326b-4fb0-a31c-ad949ca366a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:34.912193 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08c812a9-326b-4fb0-a31c-ad949ca366a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:34.916914 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:34.995701 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-08c812a9-326b-4fb0-a31c-ad949ca366a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:34.995899 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:35.005660 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-08c812a9-326b-4fb0-a31c-ad949ca366a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1621 microversion: 2.1 time: 0.107829 Jun 29 08:44:35.006224 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:35.008285 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:35.009579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b47378aa-898b-4c82-9c12-0a93d1a46ec4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.199860 Jun 29 08:44:35.010999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 412/871] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:34 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:35.014958 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 460/872] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:34 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1621 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:44:35.025464 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-67e6d61f-2abd-4155-ae7a-a094efde07a1 req-177bd4b9-7ad7-43d7-b616-6bab8d2e7d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2d8b0-44c2-4e85-9d24-0c27d7164edf", "name": "network-vif-deleted", "tag": "0bca97cc-eb16-48a9-938f-a393ebc2d7f4"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:35.033514 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-67e6d61f-2abd-4155-ae7a-a094efde07a1 req-177bd4b9-7ad7-43d7-b616-6bab8d2e7d82 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:35.033944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-67e6d61f-2abd-4155-ae7a-a094efde07a1 req-177bd4b9-7ad7-43d7-b616-6bab8d2e7d82 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:35.045063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-67e6d61f-2abd-4155-ae7a-a094efde07a1 req-177bd4b9-7ad7-43d7-b616-6bab8d2e7d82 service nova] Creating event network-vif-deleted:0bca97cc-eb16-48a9-938f-a393ebc2d7f4 for instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf on hv-cinder-79760 Jun 29 08:44:35.050614 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-67e6d61f-2abd-4155-ae7a-a094efde07a1 req-177bd4b9-7ad7-43d7-b616-6bab8d2e7d82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028993 Jun 29 08:44:35.051232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 413/873] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:44:35.436750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6d33620e-962d-4e1b-8410-b839e410f4ed tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:35.437431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6d33620e-962d-4e1b-8410-b839e410f4ed tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:35.443765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d33620e-962d-4e1b-8410-b839e410f4ed tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:35.444362 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d33620e-962d-4e1b-8410-b839e410f4ed tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:35.445194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d33620e-962d-4e1b-8410-b839e410f4ed tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:35.445693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d33620e-962d-4e1b-8410-b839e410f4ed tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:35.589624 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6d33620e-962d-4e1b-8410-b839e410f4ed tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:35.597682 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6d33620e-962d-4e1b-8410-b839e410f4ed tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.164852 Jun 29 08:44:35.598334 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 461/874] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:35 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:36.024641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:36.026098 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:36.027861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:36.029219 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:36.034482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:36.035903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:36.036818 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:36.037247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:36.048701 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:36.049421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:36.050513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:36.052681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:36.082524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:36.084905 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:36.085432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:36.086023 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lazy-loading 'fault' on Instance uuid 86b2d8b0-44c2-4e85-9d24-0c27d7164edf {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:44:36.162274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:36.170131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cdb74e9d-d239-422e-8160-c2294b971936 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 200 len: 1335 microversion: 2.1 time: 0.149991 Jun 29 08:44:36.170827 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 414/875] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:36 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 1335 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:36.230824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:36.239329 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:36.241012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:36.242069 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7ef5caba-b43a-4d84-a1c0-92da0ee2b7c3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1407 microversion: 2.20 time: 0.218095 Jun 29 08:44:36.242638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 462/876] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:36 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:44:36.390435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-27fb97f9-309a-4771-a08b-68955f4238c9 req-7f0fc335-b277-4260-bdc9-b09f852978a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6076488f-0093-4b7c-a6a9-aabd1bc916be", "name": "network-vif-plugged", "status": "completed", "tag": "81acf11d-e234-4a0d-b1b0-7ac02df25f6d"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:36.400697 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-27fb97f9-309a-4771-a08b-68955f4238c9 req-7f0fc335-b277-4260-bdc9-b09f852978a1 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:36.401145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-27fb97f9-309a-4771-a08b-68955f4238c9 req-7f0fc335-b277-4260-bdc9-b09f852978a1 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:36.415467 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-27fb97f9-309a-4771-a08b-68955f4238c9 req-7f0fc335-b277-4260-bdc9-b09f852978a1 service nova] Creating event network-vif-plugged:81acf11d-e234-4a0d-b1b0-7ac02df25f6d for instance 6076488f-0093-4b7c-a6a9-aabd1bc916be on hv-cinder-79760 Jun 29 08:44:36.420473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-27fb97f9-309a-4771-a08b-68955f4238c9 req-7f0fc335-b277-4260-bdc9-b09f852978a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035789 Jun 29 08:44:36.421075 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 415/877] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:36.615081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d3238dec-98a8-4aac-9f53-e97c4070f97b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:36.615687 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d3238dec-98a8-4aac-9f53-e97c4070f97b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:36.622178 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3238dec-98a8-4aac-9f53-e97c4070f97b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:36.622626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3238dec-98a8-4aac-9f53-e97c4070f97b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:36.623379 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3238dec-98a8-4aac-9f53-e97c4070f97b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:36.623793 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3238dec-98a8-4aac-9f53-e97c4070f97b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:36.763145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d3238dec-98a8-4aac-9f53-e97c4070f97b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:36.775235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d3238dec-98a8-4aac-9f53-e97c4070f97b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.163799 Jun 29 08:44:36.775978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 463/878] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:36 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:37.188466 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:37.189129 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 86b2d8b0-44c2-4e85-9d24-0c27d7164edf] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:37.195852 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:37.196284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:37.196982 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:37.197435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:37.211785 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] HTTP exception thrown: Instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf could not be found. Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Request method failure captured: Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf HTTP/1.1 Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7FQdokTaeGJQNjt-Zh-T_72ZIosTruGY34RQQGF3CuMCucL-NzwfI1LMeJQdYqJxdI52SbBBLbUF2WBxubSMX8i43QQfqMVuS-_FPiG8NVTwoSioRUYIeZfSiMUSeT6sA91CET2FnsLyd4oP--fhYZhW2EdAaSpSsURItcg-4mMkk Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:44:37.213971 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96872c14d1224c92b3247285f03bb966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96872c14d1224c92b3247285f03bb966"}]}] Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: ac984d1f6efa403e85483bd7fa78000e Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf could not be found. Jun 29 08:44:37.215849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '86b2d8b0-44c2-4e85-9d24-0c27d7164edf'} Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf could not be found. Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:44:37.216731 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf could not be found. Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf could not be found. Jun 29 08:44:37.218168 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:37.220716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Returning 404 to user: Instance 86b2d8b0-44c2-4e85-9d24-0c27d7164edf could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:44:37.221569 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-50938d19-be2a-4dfd-afec-1836af450c07 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf" status: 404 len: 111 microversion: 2.1 time: 0.037957 Jun 29 08:44:37.222128 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 416/879] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:37 2022] GET /compute/v2.1/servers/86b2d8b0-44c2-4e85-9d24-0c27d7164edf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:44:37.231462 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-45c10c84-1c0d-4ae9-98f7-970be483bbc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '.version_select at 0x7fade4050670>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:37.249585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-45c10c84-1c0d-4ae9-98f7-970be483bbc5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372011357" status: 202 len: 0 microversion: 2.1 time: 0.022785 Jun 29 08:44:37.250244 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 464/880] 10.222.0.27 () {58 vars in 1220 bytes} [Wed Jun 29 08:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372011357 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:44:37.259811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:37.260415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:37.266808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:37.267279 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:37.268012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:37.268437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:37.458199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:37.462103 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:37.467504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:37.468977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:37.470126 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-19cb4b95-aab7-47cc-b551-329a783e456c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1600 microversion: 2.20 time: 0.214286 Jun 29 08:44:37.470765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 417/881] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:44:37 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:44:37.487585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4930c2c7-3dd9-42cd-845e-b7b6bbdf4695 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:37.488384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4930c2c7-3dd9-42cd-845e-b7b6bbdf4695 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:37.497858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4930c2c7-3dd9-42cd-845e-b7b6bbdf4695 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:37.497858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4930c2c7-3dd9-42cd-845e-b7b6bbdf4695 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:37.497858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4930c2c7-3dd9-42cd-845e-b7b6bbdf4695 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:37.497858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4930c2c7-3dd9-42cd-845e-b7b6bbdf4695 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:37.581938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4930c2c7-3dd9-42cd-845e-b7b6bbdf4695 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098225 Jun 29 08:44:37.582567 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 465/882] 10.222.0.27 () {60 vars in 1315 bytes} [Wed Jun 29 08:44:37 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:44:37.797729 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6886ab23-aea2-409c-8fa1-3e11cf53eaf1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:37.798310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6886ab23-aea2-409c-8fa1-3e11cf53eaf1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:37.805627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6886ab23-aea2-409c-8fa1-3e11cf53eaf1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:37.806324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6886ab23-aea2-409c-8fa1-3e11cf53eaf1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:37.807146 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6886ab23-aea2-409c-8fa1-3e11cf53eaf1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:37.807694 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6886ab23-aea2-409c-8fa1-3e11cf53eaf1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:38.073736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6886ab23-aea2-409c-8fa1-3e11cf53eaf1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:38.082070 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6886ab23-aea2-409c-8fa1-3e11cf53eaf1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.288958 Jun 29 08:44:38.082623 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 418/883] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:37 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:38.584709 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-7eea6e6a-53b4-4dc3-a68f-6e9b6de9012b req-2568e2eb-f0f8-43dd-b7c8-3388e2ed3a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f64cb6c-8320-480e-b79c-bb55a51513b8", "tag": "0a7a70f1-09de-40ce-b9fe-437390cf5dab"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:38.593713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-7eea6e6a-53b4-4dc3-a68f-6e9b6de9012b req-2568e2eb-f0f8-43dd-b7c8-3388e2ed3a9f service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:38.594153 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-7eea6e6a-53b4-4dc3-a68f-6e9b6de9012b req-2568e2eb-f0f8-43dd-b7c8-3388e2ed3a9f service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:38.606107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-7eea6e6a-53b4-4dc3-a68f-6e9b6de9012b req-2568e2eb-f0f8-43dd-b7c8-3388e2ed3a9f service nova] Creating event network-changed:0a7a70f1-09de-40ce-b9fe-437390cf5dab for instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 on hv-cinder-79760 Jun 29 08:44:38.611842 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-7eea6e6a-53b4-4dc3-a68f-6e9b6de9012b req-2568e2eb-f0f8-43dd-b7c8-3388e2ed3a9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031422 Jun 29 08:44:38.612793 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 466/884] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:39.102351 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d0a34c94-188b-42fa-9587-6e61b6a425be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:39.103324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d0a34c94-188b-42fa-9587-6e61b6a425be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:39.110759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d0a34c94-188b-42fa-9587-6e61b6a425be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:39.111470 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d0a34c94-188b-42fa-9587-6e61b6a425be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:39.112248 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d0a34c94-188b-42fa-9587-6e61b6a425be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:39.112680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d0a34c94-188b-42fa-9587-6e61b6a425be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:39.263623 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d0a34c94-188b-42fa-9587-6e61b6a425be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:39.271188 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d0a34c94-188b-42fa-9587-6e61b6a425be tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1266 microversion: 2.1 time: 0.174049 Jun 29 08:44:39.271732 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 419/885] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:39 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:40.256750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d9e33690-5977-4b23-b6ca-63d356c786e5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:40.257298 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d9e33690-5977-4b23-b6ca-63d356c786e5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:40.264047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9e33690-5977-4b23-b6ca-63d356c786e5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:40.264479 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9e33690-5977-4b23-b6ca-63d356c786e5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:40.265232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9e33690-5977-4b23-b6ca-63d356c786e5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:40.265652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9e33690-5977-4b23-b6ca-63d356c786e5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:40.288175 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7d7d896c-62d4-4af4-ba53-4ab1d960f7e8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:40.288828 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7d7d896c-62d4-4af4-ba53-4ab1d960f7e8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:40.290300 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d9e33690-5977-4b23-b6ca-63d356c786e5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:44:40.295847 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d7d896c-62d4-4af4-ba53-4ab1d960f7e8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:40.296288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d7d896c-62d4-4af4-ba53-4ab1d960f7e8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:40.297056 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d7d896c-62d4-4af4-ba53-4ab1d960f7e8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:40.297484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7d7d896c-62d4-4af4-ba53-4ab1d960f7e8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:40.375472 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d9e33690-5977-4b23-b6ca-63d356c786e5 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 204 len: 0 microversion: 2.1 time: 0.122758 Jun 29 08:44:40.376359 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 467/886] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:44:40 2022] DELETE /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:44:40.385926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6858b7bd-415f-4e9e-b57f-0778fc54b4f0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:40.386628 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6858b7bd-415f-4e9e-b57f-0778fc54b4f0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:40.392953 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6858b7bd-415f-4e9e-b57f-0778fc54b4f0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:40.398752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6858b7bd-415f-4e9e-b57f-0778fc54b4f0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:40.398752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6858b7bd-415f-4e9e-b57f-0778fc54b4f0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:40.398752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6858b7bd-415f-4e9e-b57f-0778fc54b4f0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:40.449309 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7d7d896c-62d4-4af4-ba53-4ab1d960f7e8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:40.457138 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7d7d896c-62d4-4af4-ba53-4ab1d960f7e8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1452 microversion: 2.1 time: 0.172820 Jun 29 08:44:40.457927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 420/887] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:40 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:40.474646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bf88e053-8a3e-462c-89a2-687d56cc1493 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:40.475499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bf88e053-8a3e-462c-89a2-687d56cc1493 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:40.481928 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bf88e053-8a3e-462c-89a2-687d56cc1493 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:40.482372 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bf88e053-8a3e-462c-89a2-687d56cc1493 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:40.483166 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bf88e053-8a3e-462c-89a2-687d56cc1493 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:40.483594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bf88e053-8a3e-462c-89a2-687d56cc1493 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:40.567146 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6858b7bd-415f-4e9e-b57f-0778fc54b4f0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:40.577151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6858b7bd-415f-4e9e-b57f-0778fc54b4f0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1507 microversion: 2.1 time: 0.196220 Jun 29 08:44:40.577952 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 468/888] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:40 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:44:40.637880 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bf88e053-8a3e-462c-89a2-687d56cc1493 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:40.649621 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bf88e053-8a3e-462c-89a2-687d56cc1493 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1452 microversion: 2.1 time: 0.178940 Jun 29 08:44:40.650413 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 421/889] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:40 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:44:41.595477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2ffcf835-23c4-4406-8ffa-b094bec7b922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:41.596065 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2ffcf835-23c4-4406-8ffa-b094bec7b922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:41.605998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ffcf835-23c4-4406-8ffa-b094bec7b922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:41.606422 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ffcf835-23c4-4406-8ffa-b094bec7b922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:41.607421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ffcf835-23c4-4406-8ffa-b094bec7b922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:41.607842 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ffcf835-23c4-4406-8ffa-b094bec7b922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:41.812356 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2ffcf835-23c4-4406-8ffa-b094bec7b922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:41.821343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2ffcf835-23c4-4406-8ffa-b094bec7b922 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 200 len: 1507 microversion: 2.1 time: 0.229673 Jun 29 08:44:41.822729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 469/890] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:41 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:41.981703 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-33145f21-432d-49da-89f8-9428730cb964 req-9620bc98-4b18-4ebd-b1de-46b0dd5f9e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f7924b-e691-4d2b-8ea7-a4438a64d3b8", "name": "network-vif-deleted", "tag": "71f36781-07b8-496d-a3d0-c0d224617705"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:41.996737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-33145f21-432d-49da-89f8-9428730cb964 req-9620bc98-4b18-4ebd-b1de-46b0dd5f9e40 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:41.997257 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-33145f21-432d-49da-89f8-9428730cb964 req-9620bc98-4b18-4ebd-b1de-46b0dd5f9e40 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:42.012425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-33145f21-432d-49da-89f8-9428730cb964 req-9620bc98-4b18-4ebd-b1de-46b0dd5f9e40 service nova] Creating event network-vif-deleted:71f36781-07b8-496d-a3d0-c0d224617705 for instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 on hv-cinder-79760 Jun 29 08:44:42.019169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-33145f21-432d-49da-89f8-9428730cb964 req-9620bc98-4b18-4ebd-b1de-46b0dd5f9e40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044389 Jun 29 08:44:42.020352 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 422/891] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:42.655854 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-78462f84-02c8-4b68-b526-2b2234e7cf6a req-27bdecaf-6226-4b94-a2bc-48be77d70354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6076488f-0093-4b7c-a6a9-aabd1bc916be", "tag": "81acf11d-e234-4a0d-b1b0-7ac02df25f6d"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:42.664631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-78462f84-02c8-4b68-b526-2b2234e7cf6a req-27bdecaf-6226-4b94-a2bc-48be77d70354 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:42.665073 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-78462f84-02c8-4b68-b526-2b2234e7cf6a req-27bdecaf-6226-4b94-a2bc-48be77d70354 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:42.676423 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-78462f84-02c8-4b68-b526-2b2234e7cf6a req-27bdecaf-6226-4b94-a2bc-48be77d70354 service nova] Creating event network-changed:81acf11d-e234-4a0d-b1b0-7ac02df25f6d for instance 6076488f-0093-4b7c-a6a9-aabd1bc916be on hv-cinder-79760 Jun 29 08:44:42.681599 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-78462f84-02c8-4b68-b526-2b2234e7cf6a req-27bdecaf-6226-4b94-a2bc-48be77d70354 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029317 Jun 29 08:44:42.682616 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 470/892] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:42.841307 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:42.842658 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: 25f7924b-e691-4d2b-8ea7-a4438a64d3b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:42.849999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:42.850438 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:42.851260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:42.851867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:42.868490 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] HTTP exception thrown: Instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 could not be found. Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Request method failure captured: Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 HTTP/1.1 Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7FQdokTaeGJQNjt-Zh-T_72ZIosTruGY34RQQGF3CuMCucL-NzwfI1LMeJQdYqJxdI52SbBBLbUF2WBxubSMX8i43QQfqMVuS-_FPiG8NVTwoSioRUYIeZfSiMUSeT6sA91CET2FnsLyd4oP--fhYZhW2EdAaSpSsURItcg-4mMkk Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:44:42.870495 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96872c14d1224c92b3247285f03bb966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96872c14d1224c92b3247285f03bb966"}]}] Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: ac984d1f6efa403e85483bd7fa78000e Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 could not be found. Jun 29 08:44:42.871978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '25f7924b-e691-4d2b-8ea7-a4438a64d3b8'} Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 could not be found. Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:44:42.872724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 could not be found. Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 could not be found. Jun 29 08:44:42.873879 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:44:42.874975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Returning 404 to user: Instance 25f7924b-e691-4d2b-8ea7-a4438a64d3b8 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:44:42.874975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ad7af715-5548-4f7f-9b2d-637000e85328 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8" status: 404 len: 111 microversion: 2.1 time: 0.035742 Jun 29 08:44:42.874975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 423/893] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:42 2022] GET /compute/v2.1/servers/25f7924b-e691-4d2b-8ea7-a4438a64d3b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:44:42.880891 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-80bfef4c-6519-473f-b504-8e377261ddf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:42.881466 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-80bfef4c-6519-473f-b504-8e377261ddf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:42.888019 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80bfef4c-6519-473f-b504-8e377261ddf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:42.888449 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80bfef4c-6519-473f-b504-8e377261ddf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:42.889206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80bfef4c-6519-473f-b504-8e377261ddf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:42.889622 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80bfef4c-6519-473f-b504-8e377261ddf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:42.917289 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-80bfef4c-6519-473f-b504-8e377261ddf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:44:43.001471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-80bfef4c-6519-473f-b504-8e377261ddf0 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 204 len: 0 microversion: 2.1 time: 0.123174 Jun 29 08:44:43.002878 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 471/894] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:44:42 2022] DELETE /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:44:43.011977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0646f7f3-d062-46d8-90f5-6d5f2f0a63a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:43.012629 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0646f7f3-d062-46d8-90f5-6d5f2f0a63a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:43.019167 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0646f7f3-d062-46d8-90f5-6d5f2f0a63a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:43.020106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0646f7f3-d062-46d8-90f5-6d5f2f0a63a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:43.021147 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0646f7f3-d062-46d8-90f5-6d5f2f0a63a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:43.021789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0646f7f3-d062-46d8-90f5-6d5f2f0a63a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:43.156851 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0646f7f3-d062-46d8-90f5-6d5f2f0a63a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:43.164739 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0646f7f3-d062-46d8-90f5-6d5f2f0a63a3 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.157351 Jun 29 08:44:43.165301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 424/895] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:43 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:44.184283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cb67e270-2ffa-416d-b24c-b0b55649c14d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:44.185107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cb67e270-2ffa-416d-b24c-b0b55649c14d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:44.192269 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb67e270-2ffa-416d-b24c-b0b55649c14d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:44.193001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb67e270-2ffa-416d-b24c-b0b55649c14d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:44.193778 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb67e270-2ffa-416d-b24c-b0b55649c14d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:44.194334 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb67e270-2ffa-416d-b24c-b0b55649c14d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:44.327201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cb67e270-2ffa-416d-b24c-b0b55649c14d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac984d1f6efa403e85483bd7fa78000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96872c14d1224c92b3247285f03bb966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:44.335132 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cb67e270-2ffa-416d-b24c-b0b55649c14d tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 200 len: 1522 microversion: 2.1 time: 0.155785 Jun 29 08:44:44.335934 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 472/896] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:44 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:44.662910 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-09bd97d2-a488-4c93-b6a4-27cedd9ff372 req-589b29e4-9140-4216-a432-73564c8cda0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f1f6d1-d03f-4304-b607-4ea8870be425", "name": "network-vif-deleted", "tag": "b9ea90f6-200e-4036-bc3d-b3961c2cd7f6"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:44.673549 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-09bd97d2-a488-4c93-b6a4-27cedd9ff372 req-589b29e4-9140-4216-a432-73564c8cda0c service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:44.674137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-09bd97d2-a488-4c93-b6a4-27cedd9ff372 req-589b29e4-9140-4216-a432-73564c8cda0c service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:44.691569 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-09bd97d2-a488-4c93-b6a4-27cedd9ff372 req-589b29e4-9140-4216-a432-73564c8cda0c service nova] Creating event network-vif-deleted:b9ea90f6-200e-4036-bc3d-b3961c2cd7f6 for instance b8f1f6d1-d03f-4304-b607-4ea8870be425 on hv-cinder-79760 Jun 29 08:44:44.696711 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-09bd97d2-a488-4c93-b6a4-27cedd9ff372 req-589b29e4-9140-4216-a432-73564c8cda0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 Jun 29 08:44:44.697336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 425/897] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:45.352049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:45.352642 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] [instance: b8f1f6d1-d03f-4304-b607-4ea8870be425] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:45.359674 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:45.360120 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:45.360878 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:45.361299 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:45.375027 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] HTTP exception thrown: Instance b8f1f6d1-d03f-4304-b607-4ea8870be425 could not be found. Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Request method failure captured: Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 HTTP/1.1 Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7FQdokTaeGJQNjt-Zh-T_72ZIosTruGY34RQQGF3CuMCucL-NzwfI1LMeJQdYqJxdI52SbBBLbUF2WBxubSMX8i43QQfqMVuS-_FPiG8NVTwoSioRUYIeZfSiMUSeT6sA91CET2FnsLyd4oP--fhYZhW2EdAaSpSsURItcg-4mMkk Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:44:45.376654 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96872c14d1224c92b3247285f03bb966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96872c14d1224c92b3247285f03bb966"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96872c14d1224c92b3247285f03bb966"}]}] Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 96872c14d1224c92b3247285f03bb966 Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-67201216 Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: ac984d1f6efa403e85483bd7fa78000e Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-ServerRescueNegativeTestJSON-67201216-project Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance b8f1f6d1-d03f-4304-b607-4ea8870be425 could not be found. Jun 29 08:44:45.378172 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'b8f1f6d1-d03f-4304-b607-4ea8870be425'} Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f1f6d1-d03f-4304-b607-4ea8870be425 could not be found. Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:44:45.379100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f1f6d1-d03f-4304-b607-4ea8870be425 could not be found. Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f1f6d1-d03f-4304-b607-4ea8870be425 could not be found. Jun 29 08:44:45.380658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:44:45.381931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] Returning 404 to user: Instance b8f1f6d1-d03f-4304-b607-4ea8870be425 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:44:45.381931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a14edcfc-fb3e-40be-aa7c-31fe0ebf2ac8 tempest-ServerRescueNegativeTestJSON-67201216 tempest-ServerRescueNegativeTestJSON-67201216-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425" status: 404 len: 111 microversion: 2.1 time: 0.029974 Jun 29 08:44:45.381931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 473/898] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:45 2022] GET /compute/v2.1/servers/b8f1f6d1-d03f-4304-b607-4ea8870be425 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:44:54.009051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dcf44506-d1ec-4d0e-96d2-6a779f8ae464 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'create', calling method: .version_select at 0x7fade4102550>, body: {"keypair": {"name": "tempest-keypair-1251595214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu0e0Hv2rhIG5SAioSXd2BAwQl5yJM9HIGOeVds/lUffNetwXZm7j9ra/uy9c8yr/xz0RQ1Dj0gAxn9OiTDQ6DkOYJAQHT2PER5X6lECcMpaXDU2nOIou7zW3am2s+Hug=="}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:54.023293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-dcf44506-d1ec-4d0e-96d2-6a779f8ae464 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Getting quotas for project 7faee22e84ba4b8b85f4d4cf6132d83f. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:44:54.027233 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-dcf44506-d1ec-4d0e-96d2-6a779f8ae464 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Getting quotas for user 88a1f82bc0924a84849d390f138041a1 and project 7faee22e84ba4b8b85f4d4cf6132d83f. Resources: {'key_pairs'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:44:54.052153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dcf44506-d1ec-4d0e-96d2-6a779f8ae464 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177584 Jun 29 08:44:54.052825 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 426/899] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:44:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:55.416919 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-687417624", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44eadba2-f1ac-4300-8662-0179b71e9c7e"}], "security_groups": [{"name": "tempest-securitygroup--22969143"}], "key_name": "tempest-keypair-1251595214", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:55.424748 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:55.425400 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:55.525698 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] validate_networks() for [('44eadba2-f1ac-4300-8662-0179b71e9c7e', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:44:55.910932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:44:55.911391 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:44:55.911922 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:44:55.912336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:44:55.912741 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:44:55.922628 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:55.923183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:55.923999 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:55.924421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:55.941837 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Getting quotas for project 7faee22e84ba4b8b85f4d4cf6132d83f. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:44:55.946028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Getting quotas for user 88a1f82bc0924a84849d390f138041a1 and project 7faee22e84ba4b8b85f4d4cf6132d83f. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:44:55.957805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:44:55.960193 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:44:56.012130 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-34bda9e3-baff-409c-ab98-3216989af46e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.599637 Jun 29 08:44:56.013055 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 474/900] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:44:55 2022] POST /compute/v2.1/servers => generated 400 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:44:56.020811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=36 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:44:56.027899 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-fdd8f968-57db-4158-bc2f-07d92b904251 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:56.042301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fdd8f968-57db-4158-bc2f-07d92b904251 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:56.103177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-fdd8f968-57db-4158-bc2f-07d92b904251 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:56.116265 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-fdd8f968-57db-4158-bc2f-07d92b904251 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1237 microversion: 2.1 time: 0.096056 Jun 29 08:44:56.116931 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 427/901] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:56 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:57.134656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7257f475-9f4d-41f4-8836-571438660d19 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:57.135535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7257f475-9f4d-41f4-8836-571438660d19 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:57.145045 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7257f475-9f4d-41f4-8836-571438660d19 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:57.145584 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7257f475-9f4d-41f4-8836-571438660d19 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:57.146455 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7257f475-9f4d-41f4-8836-571438660d19 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:57.146969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7257f475-9f4d-41f4-8836-571438660d19 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:57.250501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7257f475-9f4d-41f4-8836-571438660d19 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:57.259596 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7257f475-9f4d-41f4-8836-571438660d19 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1297 microversion: 2.1 time: 0.129671 Jun 29 08:44:57.271780 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 475/902] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:57 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1297 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:58.289344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a6a59167-78f3-43a9-b734-293db0338c2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:58.290086 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a6a59167-78f3-43a9-b734-293db0338c2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:58.297811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6a59167-78f3-43a9-b734-293db0338c2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:58.298301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6a59167-78f3-43a9-b734-293db0338c2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:58.299152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6a59167-78f3-43a9-b734-293db0338c2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:58.299617 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6a59167-78f3-43a9-b734-293db0338c2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:58.447372 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a6a59167-78f3-43a9-b734-293db0338c2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:58.456431 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a6a59167-78f3-43a9-b734-293db0338c2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1361 microversion: 2.1 time: 0.171201 Jun 29 08:44:58.457744 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 428/903] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:58 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:44:58.599611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-954eb906-69e4-4dcf-8ddf-dd3b0bed3c91 req-40e3dc6f-9f27-488b-89ef-8f4c35eda222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1496b38e-1b75-490e-a93b-cf84acb22ef8", "tag": "5cdda97a-5352-4a7f-88fa-ab8f047cba1d"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:44:58.615527 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-954eb906-69e4-4dcf-8ddf-dd3b0bed3c91 req-40e3dc6f-9f27-488b-89ef-8f4c35eda222 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:58.615996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-954eb906-69e4-4dcf-8ddf-dd3b0bed3c91 req-40e3dc6f-9f27-488b-89ef-8f4c35eda222 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:58.635193 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-954eb906-69e4-4dcf-8ddf-dd3b0bed3c91 req-40e3dc6f-9f27-488b-89ef-8f4c35eda222 service nova] Creating event network-changed:5cdda97a-5352-4a7f-88fa-ab8f047cba1d for instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 on hv-cinder-79760 Jun 29 08:44:58.642642 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-954eb906-69e4-4dcf-8ddf-dd3b0bed3c91 req-40e3dc6f-9f27-488b-89ef-8f4c35eda222 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056697 Jun 29 08:44:58.643910 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 476/904] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:44:59.478567 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f297bfc8-d6b0-4c73-a511-18754197f547 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:44:59.480171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f297bfc8-d6b0-4c73-a511-18754197f547 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:44:59.487249 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f297bfc8-d6b0-4c73-a511-18754197f547 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:59.487702 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f297bfc8-d6b0-4c73-a511-18754197f547 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:59.488472 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f297bfc8-d6b0-4c73-a511-18754197f547 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:44:59.488903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f297bfc8-d6b0-4c73-a511-18754197f547 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:44:59.644636 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f297bfc8-d6b0-4c73-a511-18754197f547 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:44:59.652637 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f297bfc8-d6b0-4c73-a511-18754197f547 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1361 microversion: 2.1 time: 0.180432 Jun 29 08:44:59.653225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 429/905] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:44:59 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:45:00.675328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2483590d-ea8c-4e52-96a5-047b0b3d4e93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:45:00.676273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2483590d-ea8c-4e52-96a5-047b0b3d4e93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:45:00.685248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2483590d-ea8c-4e52-96a5-047b0b3d4e93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:00.685684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2483590d-ea8c-4e52-96a5-047b0b3d4e93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:00.686431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2483590d-ea8c-4e52-96a5-047b0b3d4e93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:00.686902 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2483590d-ea8c-4e52-96a5-047b0b3d4e93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:00.831896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2483590d-ea8c-4e52-96a5-047b0b3d4e93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:45:00.839972 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2483590d-ea8c-4e52-96a5-047b0b3d4e93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1361 microversion: 2.1 time: 0.172277 Jun 29 08:45:00.840858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 477/906] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:45:00 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:45:01.859802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e53fd84a-1645-4eb7-8dc4-e75f18e2b331 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:45:01.860651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e53fd84a-1645-4eb7-8dc4-e75f18e2b331 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:45:01.869053 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e53fd84a-1645-4eb7-8dc4-e75f18e2b331 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:01.869609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e53fd84a-1645-4eb7-8dc4-e75f18e2b331 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:01.870570 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e53fd84a-1645-4eb7-8dc4-e75f18e2b331 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:01.871135 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e53fd84a-1645-4eb7-8dc4-e75f18e2b331 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:02.023996 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e53fd84a-1645-4eb7-8dc4-e75f18e2b331 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:45:02.032082 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e53fd84a-1645-4eb7-8dc4-e75f18e2b331 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1361 microversion: 2.1 time: 0.177234 Jun 29 08:45:02.032648 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 430/907] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:45:01 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:45:03.056439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ea4f4181-edf8-4b53-b16c-1906fbc76d8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:45:03.057034 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ea4f4181-edf8-4b53-b16c-1906fbc76d8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:45:03.064234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ea4f4181-edf8-4b53-b16c-1906fbc76d8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:03.064678 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ea4f4181-edf8-4b53-b16c-1906fbc76d8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:03.065435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ea4f4181-edf8-4b53-b16c-1906fbc76d8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:03.065859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ea4f4181-edf8-4b53-b16c-1906fbc76d8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:03.198248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ea4f4181-edf8-4b53-b16c-1906fbc76d8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:45:03.206049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ea4f4181-edf8-4b53-b16c-1906fbc76d8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1361 microversion: 2.1 time: 0.156212 Jun 29 08:45:03.206650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 478/908] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:45:03 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:45:04.228811 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cd6acc04-7d38-4939-87dc-ab2816938b16 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:45:04.229368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cd6acc04-7d38-4939-87dc-ab2816938b16 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:45:04.236361 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cd6acc04-7d38-4939-87dc-ab2816938b16 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:04.236815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cd6acc04-7d38-4939-87dc-ab2816938b16 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:04.238244 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cd6acc04-7d38-4939-87dc-ab2816938b16 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:04.238683 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cd6acc04-7d38-4939-87dc-ab2816938b16 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:04.260284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-d15bf004-3ad5-4a61-8302-9d8d33be2127 req-1c531554-0ca6-4bce-acbf-17f7dcc0b238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1496b38e-1b75-490e-a93b-cf84acb22ef8", "name": "network-vif-plugged", "status": "completed", "tag": "5cdda97a-5352-4a7f-88fa-ab8f047cba1d"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:45:04.269769 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-d15bf004-3ad5-4a61-8302-9d8d33be2127 req-1c531554-0ca6-4bce-acbf-17f7dcc0b238 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:04.270198 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-d15bf004-3ad5-4a61-8302-9d8d33be2127 req-1c531554-0ca6-4bce-acbf-17f7dcc0b238 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:04.282213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-d15bf004-3ad5-4a61-8302-9d8d33be2127 req-1c531554-0ca6-4bce-acbf-17f7dcc0b238 service nova] Creating event network-vif-plugged:5cdda97a-5352-4a7f-88fa-ab8f047cba1d for instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 on hv-cinder-79760 Jun 29 08:45:04.290271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-d15bf004-3ad5-4a61-8302-9d8d33be2127 req-1c531554-0ca6-4bce-acbf-17f7dcc0b238 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033574 Jun 29 08:45:04.290865 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 479/909] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:45:04.383291 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cd6acc04-7d38-4939-87dc-ab2816938b16 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:45:04.391313 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cd6acc04-7d38-4939-87dc-ab2816938b16 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1361 microversion: 2.1 time: 0.166485 Jun 29 08:45:04.391883 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 431/910] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:45:04 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:45:05.412923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a14a5f1a-a0b0-43bf-9f5d-6e20bd680270 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:45:05.413981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a14a5f1a-a0b0-43bf-9f5d-6e20bd680270 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:45:05.421920 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a14a5f1a-a0b0-43bf-9f5d-6e20bd680270 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:05.422360 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a14a5f1a-a0b0-43bf-9f5d-6e20bd680270 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:05.423167 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a14a5f1a-a0b0-43bf-9f5d-6e20bd680270 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:05.423594 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a14a5f1a-a0b0-43bf-9f5d-6e20bd680270 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:05.563338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a14a5f1a-a0b0-43bf-9f5d-6e20bd680270 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:45:05.571467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a14a5f1a-a0b0-43bf-9f5d-6e20bd680270 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1361 microversion: 2.1 time: 0.165698 Jun 29 08:45:05.572030 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 480/911] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:45:05 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:45:06.588765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bf29e428-ac4b-4d55-b14c-033ab63494d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:45:06.589476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bf29e428-ac4b-4d55-b14c-033ab63494d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:45:06.592765 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:45:06.593421 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:45:06.599855 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bf29e428-ac4b-4d55-b14c-033ab63494d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:06.600292 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bf29e428-ac4b-4d55-b14c-033ab63494d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:06.601049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bf29e428-ac4b-4d55-b14c-033ab63494d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:06.601472 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bf29e428-ac4b-4d55-b14c-033ab63494d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:06.736711 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bf29e428-ac4b-4d55-b14c-033ab63494d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:45:06.744342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bf29e428-ac4b-4d55-b14c-033ab63494d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1547 microversion: 2.1 time: 0.160103 Jun 29 08:45:06.744898 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 432/912] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:45:06 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:45:06.763761 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0d279d5c-eaf8-4536-ac85-f1261e80819b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:45:06.764425 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0d279d5c-eaf8-4536-ac85-f1261e80819b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:45:06.767110 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:45:06.767855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:45:06.776494 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0d279d5c-eaf8-4536-ac85-f1261e80819b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:06.777101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0d279d5c-eaf8-4536-ac85-f1261e80819b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:06.778282 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0d279d5c-eaf8-4536-ac85-f1261e80819b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:06.779023 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0d279d5c-eaf8-4536-ac85-f1261e80819b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:06.856276 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0d279d5c-eaf8-4536-ac85-f1261e80819b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098175 Jun 29 08:45:06.856985 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 481/913] 10.222.0.27 () {58 vars in 1274 bytes} [Wed Jun 29 08:45:06 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:45:08.169133 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-7a880562-8284-432e-bfd2-5bbe8d3a1546 req-613717c0-68f9-42a8-aa29-e7d90d78fc0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1496b38e-1b75-490e-a93b-cf84acb22ef8", "tag": "5cdda97a-5352-4a7f-88fa-ab8f047cba1d"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:45:08.177927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-7a880562-8284-432e-bfd2-5bbe8d3a1546 req-613717c0-68f9-42a8-aa29-e7d90d78fc0e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:45:08.178330 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-7a880562-8284-432e-bfd2-5bbe8d3a1546 req-613717c0-68f9-42a8-aa29-e7d90d78fc0e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:45:08.189962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-7a880562-8284-432e-bfd2-5bbe8d3a1546 req-613717c0-68f9-42a8-aa29-e7d90d78fc0e service nova] Creating event network-changed:5cdda97a-5352-4a7f-88fa-ab8f047cba1d for instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 on hv-cinder-79760 Jun 29 08:45:08.195206 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-7a880562-8284-432e-bfd2-5bbe8d3a1546 req-613717c0-68f9-42a8-aa29-e7d90d78fc0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029808 Jun 29 08:45:08.196277 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 433/914] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:02.008874 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:02.009870 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=34 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:02.155159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9bb1f234-caf7-4ca7-ab5e-19709bc9c69c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:02.155680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9bb1f234-caf7-4ca7-ab5e-19709bc9c69c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:02.161894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9bb1f234-caf7-4ca7-ab5e-19709bc9c69c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:02.162330 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9bb1f234-caf7-4ca7-ab5e-19709bc9c69c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:02.163115 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9bb1f234-caf7-4ca7-ab5e-19709bc9c69c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:02.163567 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9bb1f234-caf7-4ca7-ab5e-19709bc9c69c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:02.186738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9bb1f234-caf7-4ca7-ab5e-19709bc9c69c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/ips" status: 200 len: 149 microversion: 2.1 time: 0.180280 Jun 29 08:46:02.187303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 482/915] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:46:02 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/ips => generated 149 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:04.578318 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7abe939d-55e5-4862-893b-5a9173185b50 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5717d5-8405-4d82-acd1-7c1ab2ccac2f"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:04.579508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7abe939d-55e5-4862-893b-5a9173185b50 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:04.581683 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:04.582318 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=32 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:04.588362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7abe939d-55e5-4862-893b-5a9173185b50 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:04.588807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7abe939d-55e5-4862-893b-5a9173185b50 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:04.589562 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7abe939d-55e5-4862-893b-5a9173185b50 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:04.589984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7abe939d-55e5-4862-893b-5a9173185b50 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:04.976808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7abe939d-55e5-4862-893b-5a9173185b50 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402800 Jun 29 08:46:04.977465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 434/916] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:46:04 2022] POST /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:09.066222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dd46a4eb-2d0e-4d0d-adae-85997dddb2ad tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:09.066844 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dd46a4eb-2d0e-4d0d-adae-85997dddb2ad tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:09.074650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd46a4eb-2d0e-4d0d-adae-85997dddb2ad tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:09.075126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd46a4eb-2d0e-4d0d-adae-85997dddb2ad tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:09.075878 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd46a4eb-2d0e-4d0d-adae-85997dddb2ad tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:09.076308 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd46a4eb-2d0e-4d0d-adae-85997dddb2ad tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:09.100271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-dd46a4eb-2d0e-4d0d-adae-85997dddb2ad tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lazy-loading 'flavor' on Instance uuid cbea51b8-1348-4834-badb-56258435cd06 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:46:09.195003 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dd46a4eb-2d0e-4d0d-adae-85997dddb2ad tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "POST /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06/action" status: 202 len: 0 microversion: 2.1 time: 0.134078 Jun 29 08:46:09.195585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 483/917] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:46:09 2022] POST /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:46:09.205631 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-03c3e337-af0e-4b2b-9b7c-2aa7d1c48a41 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:09.206333 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-03c3e337-af0e-4b2b-9b7c-2aa7d1c48a41 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:09.214632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-03c3e337-af0e-4b2b-9b7c-2aa7d1c48a41 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:09.215199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-03c3e337-af0e-4b2b-9b7c-2aa7d1c48a41 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:09.216334 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-03c3e337-af0e-4b2b-9b7c-2aa7d1c48a41 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:09.216770 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-03c3e337-af0e-4b2b-9b7c-2aa7d1c48a41 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:09.376381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-03c3e337-af0e-4b2b-9b7c-2aa7d1c48a41 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:09.384860 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-03c3e337-af0e-4b2b-9b7c-2aa7d1c48a41 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.184009 Jun 29 08:46:09.385431 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 435/918] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:09 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:10.407071 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bcb86900-94d5-4f9a-868a-c672210de4e9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:10.407872 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bcb86900-94d5-4f9a-868a-c672210de4e9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:10.414669 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bcb86900-94d5-4f9a-868a-c672210de4e9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:10.415142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bcb86900-94d5-4f9a-868a-c672210de4e9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:10.415942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bcb86900-94d5-4f9a-868a-c672210de4e9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:10.416365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bcb86900-94d5-4f9a-868a-c672210de4e9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:10.611315 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bcb86900-94d5-4f9a-868a-c672210de4e9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:10.621975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bcb86900-94d5-4f9a-868a-c672210de4e9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.219849 Jun 29 08:46:10.622566 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 484/919] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:10 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:11.639922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8f19881b-d7f8-4955-806a-e886d82739ea tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:11.640527 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8f19881b-d7f8-4955-806a-e886d82739ea tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:11.647605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f19881b-d7f8-4955-806a-e886d82739ea tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:11.648057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f19881b-d7f8-4955-806a-e886d82739ea tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:11.648815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f19881b-d7f8-4955-806a-e886d82739ea tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:11.649246 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f19881b-d7f8-4955-806a-e886d82739ea tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:11.791386 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8f19881b-d7f8-4955-806a-e886d82739ea tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:11.799468 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8f19881b-d7f8-4955-806a-e886d82739ea tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.163707 Jun 29 08:46:11.799966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 436/920] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:11 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:12.527530 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5717d5-8405-4d82-acd1-7c1ab2ccac2f"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:12.528684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:12.535856 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:12.536295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:12.537046 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:12.537469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:12.624163 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Invalid volume: volume 0c5717d5-8405-4d82-acd1-7c1ab2ccac2f is already attached to instances: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: POST /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments HTTP/1.1 Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 74 Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:46:12.626122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {"volumeAttachment": {"volumeId": "0c5717d5-8405-4d82-acd1-7c1ab2ccac2f"}} Jun 29 08:46:12.627620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Invalid volume: volume 0c5717d5-8405-4d82-acd1-7c1ab2ccac2f is already attached to instances: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'server_id': 'f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9', 'body': {'volumeAttachment': {'volumeId': '0c5717d5-8405-4d82-acd1-7c1ab2ccac2f'}}} Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0c5717d5-8405-4d82-acd1-7c1ab2ccac2f is already attached to instances: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:46:12.628905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0c5717d5-8405-4d82-acd1-7c1ab2ccac2f is already attached to instances: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:46:12.630112 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:46:12.631589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:46:12.631589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:46:12.631589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:46:12.631589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0c5717d5-8405-4d82-acd1-7c1ab2ccac2f is already attached to instances: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 Jun 29 08:46:12.631589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:46:12.631589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 400 to user: Invalid volume: volume 0c5717d5-8405-4d82-acd1-7c1ab2ccac2f is already attached to instances: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:46:12.631589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8e2ced4a-7685-44f9-b9e5-5252cb911a5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104122 Jun 29 08:46:12.631589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 485/921] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:46:12 2022] POST /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:46:12.690081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-dccc71b4-ef42-4103-b6d0-0a97e396dd76 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:12.690637 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-dccc71b4-ef42-4103-b6d0-0a97e396dd76 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:12.697188 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dccc71b4-ef42-4103-b6d0-0a97e396dd76 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:12.697632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dccc71b4-ef42-4103-b6d0-0a97e396dd76 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:12.698388 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dccc71b4-ef42-4103-b6d0-0a97e396dd76 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:12.698851 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-dccc71b4-ef42-4103-b6d0-0a97e396dd76 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:12.796590 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-dccc71b4-ef42-4103-b6d0-0a97e396dd76 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lazy-loading 'services' on Instance uuid f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:46:12.817503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8d71dd02-b4ff-4b80-a11e-e2ba2247ccf2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:12.818173 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8d71dd02-b4ff-4b80-a11e-e2ba2247ccf2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:12.824786 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d71dd02-b4ff-4b80-a11e-e2ba2247ccf2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:12.825229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d71dd02-b4ff-4b80-a11e-e2ba2247ccf2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:12.826017 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d71dd02-b4ff-4b80-a11e-e2ba2247ccf2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:12.826557 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d71dd02-b4ff-4b80-a11e-e2ba2247ccf2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:12.878985 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-dccc71b4-ef42-4103-b6d0-0a97e396dd76 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments/0c5717d5-8405-4d82-acd1-7c1ab2ccac2f" status: 202 len: 0 microversion: 2.1 time: 0.193014 Jun 29 08:46:12.879595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 437/922] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:46:12 2022] DELETE /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments/0c5717d5-8405-4d82-acd1-7c1ab2ccac2f => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:46:12.890286 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9772864c-baa8-4901-a7a1-3246c7f0be00 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:12.891396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9772864c-baa8-4901-a7a1-3246c7f0be00 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:12.898027 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9772864c-baa8-4901-a7a1-3246c7f0be00 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:12.898498 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9772864c-baa8-4901-a7a1-3246c7f0be00 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:12.899387 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9772864c-baa8-4901-a7a1-3246c7f0be00 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:12.899894 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9772864c-baa8-4901-a7a1-3246c7f0be00 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:12.933501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9772864c-baa8-4901-a7a1-3246c7f0be00 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049132 Jun 29 08:46:12.934379 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 438/923] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:46:12 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:46:12.964091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8d71dd02-b4ff-4b80-a11e-e2ba2247ccf2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:12.972663 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8d71dd02-b4ff-4b80-a11e-e2ba2247ccf2 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.159167 Jun 29 08:46:12.973221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 486/924] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:12 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:13.946307 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0d02fc2c-fbd9-4eed-9493-39784b841901 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:13.947263 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0d02fc2c-fbd9-4eed-9493-39784b841901 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:13.954828 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d02fc2c-fbd9-4eed-9493-39784b841901 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:13.955274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d02fc2c-fbd9-4eed-9493-39784b841901 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:13.956040 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d02fc2c-fbd9-4eed-9493-39784b841901 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:13.956503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0d02fc2c-fbd9-4eed-9493-39784b841901 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:13.989919 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a82e21e9-d119-46fc-b391-ad1c0c0c97d1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:13.990487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a82e21e9-d119-46fc-b391-ad1c0c0c97d1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:13.993799 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0d02fc2c-fbd9-4eed-9493-39784b841901 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051546 Jun 29 08:46:13.994576 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 439/925] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:46:13 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:46:13.998890 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a82e21e9-d119-46fc-b391-ad1c0c0c97d1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:13.999977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a82e21e9-d119-46fc-b391-ad1c0c0c97d1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:14.001059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a82e21e9-d119-46fc-b391-ad1c0c0c97d1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:14.001800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a82e21e9-d119-46fc-b391-ad1c0c0c97d1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:14.053927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-fd40f5b3-6809-4b97-83c5-6cef07b9a406 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:14.054418 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fd40f5b3-6809-4b97-83c5-6cef07b9a406 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:14.060944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fd40f5b3-6809-4b97-83c5-6cef07b9a406 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:14.061383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fd40f5b3-6809-4b97-83c5-6cef07b9a406 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:14.062140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fd40f5b3-6809-4b97-83c5-6cef07b9a406 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:14.062564 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fd40f5b3-6809-4b97-83c5-6cef07b9a406 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:14.087514 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fd40f5b3-6809-4b97-83c5-6cef07b9a406 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:46:14.137830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a82e21e9-d119-46fc-b391-ad1c0c0c97d1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:14.147001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a82e21e9-d119-46fc-b391-ad1c0c0c97d1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.161174 Jun 29 08:46:14.147514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 487/926] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:13 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:14.170531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-fd40f5b3-6809-4b97-83c5-6cef07b9a406 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 204 len: 0 microversion: 2.1 time: 0.119971 Jun 29 08:46:14.171221 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 440/927] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:46:14 2022] DELETE /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 08:46:14.179999 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-040176f3-a10d-44dd-81b9-f695f3b6ee07 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:14.180671 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-040176f3-a10d-44dd-81b9-f695f3b6ee07 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:14.186979 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-040176f3-a10d-44dd-81b9-f695f3b6ee07 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:14.187431 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-040176f3-a10d-44dd-81b9-f695f3b6ee07 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:14.188180 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-040176f3-a10d-44dd-81b9-f695f3b6ee07 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:14.188602 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-040176f3-a10d-44dd-81b9-f695f3b6ee07 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:14.333779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-040176f3-a10d-44dd-81b9-f695f3b6ee07 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:14.341937 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-040176f3-a10d-44dd-81b9-f695f3b6ee07 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1681 microversion: 2.1 time: 0.165714 Jun 29 08:46:14.342479 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 488/928] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:14 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:15.165577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1779236d-cc4a-49f8-97bc-66bc9fb9655d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:15.166275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1779236d-cc4a-49f8-97bc-66bc9fb9655d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:15.173027 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1779236d-cc4a-49f8-97bc-66bc9fb9655d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:15.173456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1779236d-cc4a-49f8-97bc-66bc9fb9655d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:15.174198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1779236d-cc4a-49f8-97bc-66bc9fb9655d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:15.174616 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1779236d-cc4a-49f8-97bc-66bc9fb9655d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:15.321734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1779236d-cc4a-49f8-97bc-66bc9fb9655d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:15.334767 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1779236d-cc4a-49f8-97bc-66bc9fb9655d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.173075 Jun 29 08:46:15.335704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 441/929] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:15 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:15.359631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8577af0f-c066-49c0-bcad-54d800aa847c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:15.360201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8577af0f-c066-49c0-bcad-54d800aa847c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:15.367358 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8577af0f-c066-49c0-bcad-54d800aa847c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:15.367791 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8577af0f-c066-49c0-bcad-54d800aa847c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:15.368545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8577af0f-c066-49c0-bcad-54d800aa847c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:15.368969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8577af0f-c066-49c0-bcad-54d800aa847c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:15.507623 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8577af0f-c066-49c0-bcad-54d800aa847c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:15.518009 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8577af0f-c066-49c0-bcad-54d800aa847c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1681 microversion: 2.1 time: 0.162441 Jun 29 08:46:15.518553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 489/930] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:15 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:16.358926 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-213fdbed-997e-4435-a332-ed989c314aef tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:16.359551 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-213fdbed-997e-4435-a332-ed989c314aef tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:16.366363 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-213fdbed-997e-4435-a332-ed989c314aef tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:16.366838 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-213fdbed-997e-4435-a332-ed989c314aef tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:16.367608 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-213fdbed-997e-4435-a332-ed989c314aef tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:16.368059 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-213fdbed-997e-4435-a332-ed989c314aef tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:16.503112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-213fdbed-997e-4435-a332-ed989c314aef tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:16.511007 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-213fdbed-997e-4435-a332-ed989c314aef tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.158235 Jun 29 08:46:16.511952 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 442/931] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:16 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:16.540865 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-45d59af5-bdad-4aaa-953a-15b3549009f2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:16.541447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-45d59af5-bdad-4aaa-953a-15b3549009f2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:16.548656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-45d59af5-bdad-4aaa-953a-15b3549009f2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:16.549096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-45d59af5-bdad-4aaa-953a-15b3549009f2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:16.549860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-45d59af5-bdad-4aaa-953a-15b3549009f2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:16.550288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-45d59af5-bdad-4aaa-953a-15b3549009f2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:16.685760 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-45d59af5-bdad-4aaa-953a-15b3549009f2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:16.693486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-45d59af5-bdad-4aaa-953a-15b3549009f2 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1681 microversion: 2.1 time: 0.156541 Jun 29 08:46:16.694110 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 490/932] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:16 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:17.304205 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-3874fd64-06af-4b6d-b85c-8e406637d458 req-cc531586-a7f1-4e34-ac83-ae0166ef7370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9", "name": "network-vif-deleted", "tag": "f0a90872-a515-411d-a8fc-fb4523dd5f0a"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:17.313281 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-3874fd64-06af-4b6d-b85c-8e406637d458 req-cc531586-a7f1-4e34-ac83-ae0166ef7370 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:17.314135 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-3874fd64-06af-4b6d-b85c-8e406637d458 req-cc531586-a7f1-4e34-ac83-ae0166ef7370 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:17.326918 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-3874fd64-06af-4b6d-b85c-8e406637d458 req-cc531586-a7f1-4e34-ac83-ae0166ef7370 service nova] Creating event network-vif-deleted:f0a90872-a515-411d-a8fc-fb4523dd5f0a for instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 on hv-cinder-79760 Jun 29 08:46:17.333318 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-3874fd64-06af-4b6d-b85c-8e406637d458 req-cc531586-a7f1-4e34-ac83-ae0166ef7370 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111450 Jun 29 08:46:17.334060 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 443/933] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:17.529307 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d740643e-4b78-407c-ba84-b3c0f8278afb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:17.529884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d740643e-4b78-407c-ba84-b3c0f8278afb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:17.536229 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d740643e-4b78-407c-ba84-b3c0f8278afb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:17.536671 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d740643e-4b78-407c-ba84-b3c0f8278afb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:17.537457 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d740643e-4b78-407c-ba84-b3c0f8278afb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:17.537847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d740643e-4b78-407c-ba84-b3c0f8278afb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:17.672107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d740643e-4b78-407c-ba84-b3c0f8278afb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:17.681183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d740643e-4b78-407c-ba84-b3c0f8278afb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.155511 Jun 29 08:46:17.681764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 491/934] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:17 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:17.711655 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:17.712355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:17.719232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:17.719675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:17.720529 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:17.720947 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:17.753910 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:17.754349 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:17.754823 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lazy-loading 'fault' on Instance uuid f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:46:17.798243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:17.807192 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5992acd2-6b26-4f29-9486-4343a05622ae tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 200 len: 1331 microversion: 2.1 time: 0.100150 Jun 29 08:46:17.808020 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 444/935] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:17 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:18.698352 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0bc4e38b-0d2d-40a1-adf2-c33c11273491 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:18.698993 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0bc4e38b-0d2d-40a1-adf2-c33c11273491 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:18.706121 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0bc4e38b-0d2d-40a1-adf2-c33c11273491 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:18.706568 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0bc4e38b-0d2d-40a1-adf2-c33c11273491 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:18.707354 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0bc4e38b-0d2d-40a1-adf2-c33c11273491 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:18.707780 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0bc4e38b-0d2d-40a1-adf2-c33c11273491 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:18.825207 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:18.825793 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:18.832746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:18.833189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:18.833981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:18.834428 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:18.848307 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 HTTP/1.1 Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:46:18.850236 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:46:18.851862 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9'} Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:46:18.852780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:46:18.854288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:46:18.855647 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:46:18.855647 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bbe51563-4e2f-41fb-9fdf-d1aed2bc0ee0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 404 len: 111 microversion: 2.1 time: 0.030553 Jun 29 08:46:18.855647 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 445/936] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:18 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:46:18.855909 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0bc4e38b-0d2d-40a1-adf2-c33c11273491 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:18.863353 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0bc4e38b-0d2d-40a1-adf2-c33c11273491 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.168886 Jun 29 08:46:18.863922 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 492/937] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:18 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:18.864690 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-62891e9a-8e4d-46fa-be4f-1e25407d3646 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '.version_select at 0x7fade7917280>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:18.889692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-62891e9a-8e4d-46fa-be4f-1e25407d3646 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102382217" status: 202 len: 0 microversion: 2.1 time: 0.028402 Jun 29 08:46:18.890185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 446/938] 10.222.0.27 () {58 vars in 1220 bytes} [Wed Jun 29 08:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102382217 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:46:19.524645 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-54d7cf08-d721-46f0-a04f-e355752669c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: .version_select at 0x7faddeffb430>, body: {"keypair": {"name": "tempest-keypair-911874527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqQV+QEXwl1X/6UgN5hP6TeQch5XG831HbioOo9TSmFbeJy8DMKuBigYTrRgnqcvjyx5Eg1vghsUyeTd+lKeDxC0lzDoapXuAqok/GuEn8WxVhogb15sxdlxOD+xYgEmA=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:19.539111 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-54d7cf08-d721-46f0-a04f-e355752669c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:46:19.543001 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-54d7cf08-d721-46f0-a04f-e355752669c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for user bccf002d9da34d1dad0ee71b5b7bb1c1 and project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:46:19.568675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-54d7cf08-d721-46f0-a04f-e355752669c5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047894 Jun 29 08:46:19.569281 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 493/939] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:46:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:19.881189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3f0250d1-151b-4089-92e3-ff1b7c00e2cb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:19.881805 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3f0250d1-151b-4089-92e3-ff1b7c00e2cb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:19.890508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3f0250d1-151b-4089-92e3-ff1b7c00e2cb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:19.891220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3f0250d1-151b-4089-92e3-ff1b7c00e2cb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:19.892014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3f0250d1-151b-4089-92e3-ff1b7c00e2cb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:19.892450 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3f0250d1-151b-4089-92e3-ff1b7c00e2cb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:20.341087 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3f0250d1-151b-4089-92e3-ff1b7c00e2cb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:20.349902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3f0250d1-151b-4089-92e3-ff1b7c00e2cb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.473199 Jun 29 08:46:20.350738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 447/940] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:19 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:20.884985 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-01e3e592-fb6d-4a67-abe4-cc64843e7f1e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:20.885485 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-01e3e592-fb6d-4a67-abe4-cc64843e7f1e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:20.892011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01e3e592-fb6d-4a67-abe4-cc64843e7f1e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:20.892455 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01e3e592-fb6d-4a67-abe4-cc64843e7f1e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:20.893213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01e3e592-fb6d-4a67-abe4-cc64843e7f1e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:20.893704 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01e3e592-fb6d-4a67-abe4-cc64843e7f1e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:20.917008 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-01e3e592-fb6d-4a67-abe4-cc64843e7f1e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/ips" status: 200 len: 152 microversion: 2.20 time: 0.170819 Jun 29 08:46:20.923077 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 494/941] 10.222.0.27 () {60 vars in 1288 bytes} [Wed Jun 29 08:46:20 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/ips => generated 152 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:46:21.367928 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c53f0912-c9b2-4285-be5b-01815dbe9376 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:21.368533 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c53f0912-c9b2-4285-be5b-01815dbe9376 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:21.375787 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c53f0912-c9b2-4285-be5b-01815dbe9376 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:21.376227 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c53f0912-c9b2-4285-be5b-01815dbe9376 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:21.377008 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c53f0912-c9b2-4285-be5b-01815dbe9376 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:21.377442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c53f0912-c9b2-4285-be5b-01815dbe9376 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:21.422221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1393957112", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fbe4e8a-ed08-40e1-b1bc-8913ebef6d94"}], "security_groups": [{"name": "tempest-securitygroup--569101749"}], "key_name": "tempest-keypair-911874527", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:21.543039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c53f0912-c9b2-4285-be5b-01815dbe9376 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:21.546963 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:21.551901 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c53f0912-c9b2-4285-be5b-01815dbe9376 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.187988 Jun 29 08:46:21.552483 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 448/942] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:21 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:21.558321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] validate_networks() for [('7fbe4e8a-ed08-40e1-b1bc-8913ebef6d94', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:46:22.001262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:46:22.001880 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:46:22.002180 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:46:22.002601 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:46:22.003028 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:46:22.011886 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.012322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.013105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.013532 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.030206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:46:22.034186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Getting quotas for user bccf002d9da34d1dad0ee71b5b7bb1c1 and project 8f94b91ae9ee464aa2f5e24f5e8e0f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:46:22.045032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:46:22.047384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:46:22.096276 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9d83453b-7bd3-468c-b840-19a1895be7e3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.678417 Jun 29 08:46:22.096871 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 495/943] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:46:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:46:22.108783 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e4bc4872-1180-49ad-83c4-638806079f78 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:22.109783 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e4bc4872-1180-49ad-83c4-638806079f78 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:22.178439 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e4bc4872-1180-49ad-83c4-638806079f78 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:22.185691 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e4bc4872-1180-49ad-83c4-638806079f78 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1241 microversion: 2.1 time: 0.082073 Jun 29 08:46:22.186919 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 449/944] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:22 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:22.569730 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8d61a63d-368d-45d8-9d25-e4f8b96a862b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:22.570370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8d61a63d-368d-45d8-9d25-e4f8b96a862b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:22.576750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d61a63d-368d-45d8-9d25-e4f8b96a862b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.577170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d61a63d-368d-45d8-9d25-e4f8b96a862b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.577959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d61a63d-368d-45d8-9d25-e4f8b96a862b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.578391 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d61a63d-368d-45d8-9d25-e4f8b96a862b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.723035 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8d61a63d-368d-45d8-9d25-e4f8b96a862b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:22.735315 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8d61a63d-368d-45d8-9d25-e4f8b96a862b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1567 microversion: 2.1 time: 0.169266 Jun 29 08:46:22.736041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 496/945] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:22 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:22.757089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4336517c-f265-4e22-b728-b31da44e3c6e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:22.757627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4336517c-f265-4e22-b728-b31da44e3c6e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:22.764559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4336517c-f265-4e22-b728-b31da44e3c6e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.764997 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4336517c-f265-4e22-b728-b31da44e3c6e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.765747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4336517c-f265-4e22-b728-b31da44e3c6e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.766171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4336517c-f265-4e22-b728-b31da44e3c6e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.909051 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4336517c-f265-4e22-b728-b31da44e3c6e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "POST /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06/action" status: 202 len: 0 microversion: 2.1 time: 0.155873 Jun 29 08:46:22.909654 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 450/946] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:46:22 2022] POST /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:46:22.917681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e6045d17-a2a7-4e69-8056-eec1e2022e3d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:22.918322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e6045d17-a2a7-4e69-8056-eec1e2022e3d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:22.926132 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6045d17-a2a7-4e69-8056-eec1e2022e3d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.926869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6045d17-a2a7-4e69-8056-eec1e2022e3d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.927822 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6045d17-a2a7-4e69-8056-eec1e2022e3d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.928252 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6045d17-a2a7-4e69-8056-eec1e2022e3d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.959001 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-fbffc83d-5056-4784-a599-5e9211fed6f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:22.962973 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fbffc83d-5056-4784-a599-5e9211fed6f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:22.974464 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fbffc83d-5056-4784-a599-5e9211fed6f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.975222 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fbffc83d-5056-4784-a599-5e9211fed6f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:22.976202 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fbffc83d-5056-4784-a599-5e9211fed6f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:22.976827 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fbffc83d-5056-4784-a599-5e9211fed6f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:23.000990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-fbffc83d-5056-4784-a599-5e9211fed6f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lazy-loading 'flavor' on Instance uuid 5f64cb6c-8320-480e-b79c-bb55a51513b8 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:46:23.069403 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e6045d17-a2a7-4e69-8056-eec1e2022e3d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:23.078296 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e6045d17-a2a7-4e69-8056-eec1e2022e3d tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1575 microversion: 2.1 time: 0.164379 Jun 29 08:46:23.079666 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 497/947] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:22 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:23.203210 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-614a941a-6e00-4230-a86c-d475994626d4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:23.203817 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-614a941a-6e00-4230-a86c-d475994626d4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:23.264405 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-614a941a-6e00-4230-a86c-d475994626d4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:23.271213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-614a941a-6e00-4230-a86c-d475994626d4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1241 microversion: 2.1 time: 0.071981 Jun 29 08:46:23.273091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 498/948] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:23 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:46:23.332840 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-fbffc83d-5056-4784-a599-5e9211fed6f0 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/action" status: 202 len: 0 microversion: 2.20 time: 0.377865 Jun 29 08:46:23.333553 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 451/949] 10.222.0.27 () {62 vars in 1318 bytes} [Wed Jun 29 08:46:22 2022] POST /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:46:23.342066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:23.342955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:23.352831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:23.353255 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:23.354032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:23.354441 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:23.506851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:23.511184 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:23.518026 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:23.519809 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:23.521036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-58c451ab-8f27-4902-a2a8-50dbde882447 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.183403 Jun 29 08:46:23.521823 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 499/950] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:23 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:24.099735 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6546149f-9cdd-48a9-ba87-fa44fac7d362 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:24.100515 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6546149f-9cdd-48a9-ba87-fa44fac7d362 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:24.108249 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6546149f-9cdd-48a9-ba87-fa44fac7d362 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:24.108773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6546149f-9cdd-48a9-ba87-fa44fac7d362 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:24.109774 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6546149f-9cdd-48a9-ba87-fa44fac7d362 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:24.110403 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6546149f-9cdd-48a9-ba87-fa44fac7d362 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:24.256910 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6546149f-9cdd-48a9-ba87-fa44fac7d362 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:24.268955 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6546149f-9cdd-48a9-ba87-fa44fac7d362 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1517 microversion: 2.1 time: 0.174290 Jun 29 08:46:24.269815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 452/951] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:24 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:24.290266 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1d6503a0-8e08-4a67-b467-ab785b0a5547 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:24.290962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1d6503a0-8e08-4a67-b467-ab785b0a5547 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:24.298669 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d6503a0-8e08-4a67-b467-ab785b0a5547 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:24.299137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d6503a0-8e08-4a67-b467-ab785b0a5547 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:24.299893 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d6503a0-8e08-4a67-b467-ab785b0a5547 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:24.300320 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d6503a0-8e08-4a67-b467-ab785b0a5547 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:24.363243 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d6503a0-8e08-4a67-b467-ab785b0a5547 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:24.370884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1d6503a0-8e08-4a67-b467-ab785b0a5547 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1245 microversion: 2.1 time: 0.084914 Jun 29 08:46:24.371473 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 500/952] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:24 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:24.540457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:24.541075 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:24.547751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:24.548193 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:24.548941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:24.549366 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:24.695091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:24.705644 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:24.707150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:24.708321 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6beccd07-4d15-4d1a-801f-b1af45bf2415 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.171836 Jun 29 08:46:24.708855 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 453/953] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:24 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:24.860643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-0a570258-d946-4e02-9f00-14fb18861e4f req-9895d3e7-b6e4-493a-93b4-021838feec32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbea51b8-1348-4834-badb-56258435cd06", "name": "network-vif-unplugged", "status": "completed", "tag": "d7fdedc4-9082-4237-a3a6-f3fe54501c3f"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:24.868835 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-0a570258-d946-4e02-9f00-14fb18861e4f req-9895d3e7-b6e4-493a-93b4-021838feec32 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:24.869250 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-0a570258-d946-4e02-9f00-14fb18861e4f req-9895d3e7-b6e4-493a-93b4-021838feec32 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:24.880849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-0a570258-d946-4e02-9f00-14fb18861e4f req-9895d3e7-b6e4-493a-93b4-021838feec32 service nova] Creating event network-vif-unplugged:d7fdedc4-9082-4237-a3a6-f3fe54501c3f for instance cbea51b8-1348-4834-badb-56258435cd06 on hv-cinder-79760 Jun 29 08:46:24.886792 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-0a570258-d946-4e02-9f00-14fb18861e4f req-9895d3e7-b6e4-493a-93b4-021838feec32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085808 Jun 29 08:46:24.887385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 501/954] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:25.295459 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-697e7b48-bf7e-4411-8745-ecbe4c613be0 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:25.296455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-697e7b48-bf7e-4411-8745-ecbe4c613be0 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:25.304456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-697e7b48-bf7e-4411-8745-ecbe4c613be0 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:25.304899 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-697e7b48-bf7e-4411-8745-ecbe4c613be0 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:25.305665 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-697e7b48-bf7e-4411-8745-ecbe4c613be0 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:25.306092 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-697e7b48-bf7e-4411-8745-ecbe4c613be0 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:25.390239 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-78ca9dc9-6d63-4cc3-9222-ccfb7c39e898 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:25.391377 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-78ca9dc9-6d63-4cc3-9222-ccfb7c39e898 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:25.399658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78ca9dc9-6d63-4cc3-9222-ccfb7c39e898 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:25.400195 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78ca9dc9-6d63-4cc3-9222-ccfb7c39e898 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:25.400994 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78ca9dc9-6d63-4cc3-9222-ccfb7c39e898 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:25.401416 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78ca9dc9-6d63-4cc3-9222-ccfb7c39e898 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:25.485994 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-78ca9dc9-6d63-4cc3-9222-ccfb7c39e898 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:25.488872 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-697e7b48-bf7e-4411-8745-ecbe4c613be0 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:25.494288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-78ca9dc9-6d63-4cc3-9222-ccfb7c39e898 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1293 microversion: 2.1 time: 0.109859 Jun 29 08:46:25.494992 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 502/955] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:25 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:25.501667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-697e7b48-bf7e-4411-8745-ecbe4c613be0 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.212893 Jun 29 08:46:25.508871 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 454/956] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:25 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:25.726885 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:25.727718 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:25.735448 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:25.736101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:25.737692 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:25.739147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:25.948706 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:25.958241 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:25.959788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:25.961090 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d65b26e7-4f2b-447c-a745-d3a5013fd1ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.238440 Jun 29 08:46:25.972384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 503/957] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:25 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:26.514949 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a6522747-3096-4561-b8bd-446f2398d9ee tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:26.515942 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a6522747-3096-4561-b8bd-446f2398d9ee tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:26.522798 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bbf99a64-6d13-421f-966c-ffe7f52dfe44 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:26.523745 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bbf99a64-6d13-421f-966c-ffe7f52dfe44 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:26.526273 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6522747-3096-4561-b8bd-446f2398d9ee tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:26.526968 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6522747-3096-4561-b8bd-446f2398d9ee tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:26.528173 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6522747-3096-4561-b8bd-446f2398d9ee tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:26.528785 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a6522747-3096-4561-b8bd-446f2398d9ee tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:26.533385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbf99a64-6d13-421f-966c-ffe7f52dfe44 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:26.533792 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbf99a64-6d13-421f-966c-ffe7f52dfe44 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:26.534809 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbf99a64-6d13-421f-966c-ffe7f52dfe44 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:26.535209 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bbf99a64-6d13-421f-966c-ffe7f52dfe44 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:26.734725 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a6522747-3096-4561-b8bd-446f2398d9ee tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:26.738603 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bbf99a64-6d13-421f-966c-ffe7f52dfe44 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:26.742733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a6522747-3096-4561-b8bd-446f2398d9ee tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1366 microversion: 2.1 time: 0.233961 Jun 29 08:46:26.743371 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 455/958] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:26 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:26.747865 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bbf99a64-6d13-421f-966c-ffe7f52dfe44 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.231186 Jun 29 08:46:26.748570 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 504/959] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:26 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:26.990759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:26.991743 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:27.001373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:27.001814 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:27.002575 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:27.003021 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:27.242127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:27.251758 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:27.253293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:27.254460 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cfbd3910-ac25-42ce-aeb8-24bb74c6cd27 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.271220 Jun 29 08:46:27.255024 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 456/960] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:26 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:27.761828 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5c36f43f-2f2f-44cd-905a-d9dd21d15a69 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:27.762826 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5c36f43f-2f2f-44cd-905a-d9dd21d15a69 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:27.763163 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-c012e113-388c-41cd-a82e-40516b438929 req-ebfb2edb-f864-4652-bc34-124ae2aecfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd356b2c-5d79-440e-9710-0e7808621c28", "tag": "365adfee-4d17-44f7-9396-323504eaff0c"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:27.777309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-c012e113-388c-41cd-a82e-40516b438929 req-ebfb2edb-f864-4652-bc34-124ae2aecfe7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:27.777743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-c012e113-388c-41cd-a82e-40516b438929 req-ebfb2edb-f864-4652-bc34-124ae2aecfe7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:27.782243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c36f43f-2f2f-44cd-905a-d9dd21d15a69 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:27.782760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c36f43f-2f2f-44cd-905a-d9dd21d15a69 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:27.783498 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c36f43f-2f2f-44cd-905a-d9dd21d15a69 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:27.783928 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5c36f43f-2f2f-44cd-905a-d9dd21d15a69 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:27.797581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-c012e113-388c-41cd-a82e-40516b438929 req-ebfb2edb-f864-4652-bc34-124ae2aecfe7 service nova] Creating event network-changed:365adfee-4d17-44f7-9396-323504eaff0c for instance dd356b2c-5d79-440e-9710-0e7808621c28 on hv-cinder-79760 Jun 29 08:46:27.803326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-c012e113-388c-41cd-a82e-40516b438929 req-ebfb2edb-f864-4652-bc34-124ae2aecfe7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119015 Jun 29 08:46:27.804406 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 505/961] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:27.810582 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-004c6cd8-c627-440c-a670-0f2ee5e0d257 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:27.811485 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-004c6cd8-c627-440c-a670-0f2ee5e0d257 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:27.819909 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-004c6cd8-c627-440c-a670-0f2ee5e0d257 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:27.820357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-004c6cd8-c627-440c-a670-0f2ee5e0d257 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:27.821133 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-004c6cd8-c627-440c-a670-0f2ee5e0d257 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:27.821565 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-004c6cd8-c627-440c-a670-0f2ee5e0d257 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:28.077922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5c36f43f-2f2f-44cd-905a-d9dd21d15a69 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:28.085796 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5c36f43f-2f2f-44cd-905a-d9dd21d15a69 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1366 microversion: 2.1 time: 0.328259 Jun 29 08:46:28.086593 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 457/962] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:27 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:28.089627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-004c6cd8-c627-440c-a670-0f2ee5e0d257 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:28.098095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-004c6cd8-c627-440c-a670-0f2ee5e0d257 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.292344 Jun 29 08:46:28.098798 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 506/963] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:27 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:28.274287 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:28.274950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:28.281333 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:28.281966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:28.282824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:28.283325 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:28.426929 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:28.435363 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:28.436858 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:28.438111 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9feb3dfe-afeb-4d50-9ae6-4405b0787fb6 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.167879 Jun 29 08:46:28.438720 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 458/964] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:28 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:29.106598 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9865527d-e2dd-463a-9087-15bba5e8ac68 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:29.107197 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9865527d-e2dd-463a-9087-15bba5e8ac68 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:29.115087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9865527d-e2dd-463a-9087-15bba5e8ac68 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:29.115445 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6c173572-9296-45c4-b245-d4872fb17709 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:29.115914 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9865527d-e2dd-463a-9087-15bba5e8ac68 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:29.116017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6c173572-9296-45c4-b245-d4872fb17709 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:29.116282 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9865527d-e2dd-463a-9087-15bba5e8ac68 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:29.116691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9865527d-e2dd-463a-9087-15bba5e8ac68 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:29.122965 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6c173572-9296-45c4-b245-d4872fb17709 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:29.123726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6c173572-9296-45c4-b245-d4872fb17709 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:29.124522 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6c173572-9296-45c4-b245-d4872fb17709 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:29.124985 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6c173572-9296-45c4-b245-d4872fb17709 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:29.310503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9865527d-e2dd-463a-9087-15bba5e8ac68 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:29.314469 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6c173572-9296-45c4-b245-d4872fb17709 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:29.318484 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9865527d-e2dd-463a-9087-15bba5e8ac68 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1366 microversion: 2.1 time: 0.218235 Jun 29 08:46:29.319066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 507/965] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:29 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:29.322612 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6c173572-9296-45c4-b245-d4872fb17709 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.211087 Jun 29 08:46:29.323218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 459/966] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:29 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:29.457272 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:29.457756 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:29.466470 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:29.467120 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:29.468268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:29.468984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:29.609692 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:29.621030 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:29.623302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:29.625101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8a7f8bca-1808-47bc-aadf-fe1e9211394b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.171584 Jun 29 08:46:29.625520 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 508/967] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:29 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:30.340869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-52d04eb2-6524-4520-a369-1d0678979d5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:30.341835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-52d04eb2-6524-4520-a369-1d0678979d5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:30.344083 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ef9c172d-589f-49a8-ad72-f8ec7405a3e3 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:30.345081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ef9c172d-589f-49a8-ad72-f8ec7405a3e3 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:30.352558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-52d04eb2-6524-4520-a369-1d0678979d5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:30.353281 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-52d04eb2-6524-4520-a369-1d0678979d5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:30.354523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-52d04eb2-6524-4520-a369-1d0678979d5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:30.355276 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-52d04eb2-6524-4520-a369-1d0678979d5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:30.355677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef9c172d-589f-49a8-ad72-f8ec7405a3e3 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:30.356395 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef9c172d-589f-49a8-ad72-f8ec7405a3e3 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:30.357635 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef9c172d-589f-49a8-ad72-f8ec7405a3e3 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:30.358336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef9c172d-589f-49a8-ad72-f8ec7405a3e3 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:30.558062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ef9c172d-589f-49a8-ad72-f8ec7405a3e3 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:30.561294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-52d04eb2-6524-4520-a369-1d0678979d5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:30.565950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ef9c172d-589f-49a8-ad72-f8ec7405a3e3 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.229185 Jun 29 08:46:30.566632 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 509/968] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:30 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:30.569081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-52d04eb2-6524-4520-a369-1d0678979d5a tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1366 microversion: 2.1 time: 0.235552 Jun 29 08:46:30.569635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 460/969] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:30 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:30.643596 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:30.644205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:30.650907 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:30.651347 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:30.652097 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:30.652504 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:30.788643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:30.797155 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:30.799091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:30.800262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-eb9b23f8-793c-495d-ba7b-0d93d1dbdb26 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.160693 Jun 29 08:46:30.800828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 510/970] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:30 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:31.587700 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-aeb9aef3-6abb-4f8d-adca-054789aeb6fb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:31.588650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-aeb9aef3-6abb-4f8d-adca-054789aeb6fb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:31.591524 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c93d8a5c-85d0-440f-9a97-aeff01551ac7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:31.592518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c93d8a5c-85d0-440f-9a97-aeff01551ac7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:31.597310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aeb9aef3-6abb-4f8d-adca-054789aeb6fb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:31.597747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aeb9aef3-6abb-4f8d-adca-054789aeb6fb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:31.598499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aeb9aef3-6abb-4f8d-adca-054789aeb6fb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:31.598944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aeb9aef3-6abb-4f8d-adca-054789aeb6fb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:31.599980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c93d8a5c-85d0-440f-9a97-aeff01551ac7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:31.600421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c93d8a5c-85d0-440f-9a97-aeff01551ac7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:31.601175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c93d8a5c-85d0-440f-9a97-aeff01551ac7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:31.601601 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c93d8a5c-85d0-440f-9a97-aeff01551ac7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:31.799713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-aeb9aef3-6abb-4f8d-adca-054789aeb6fb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:31.802805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c93d8a5c-85d0-440f-9a97-aeff01551ac7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:31.807379 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-aeb9aef3-6abb-4f8d-adca-054789aeb6fb tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.226174 Jun 29 08:46:31.808102 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 461/971] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:31 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:31.810537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c93d8a5c-85d0-440f-9a97-aeff01551ac7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1366 microversion: 2.1 time: 0.225989 Jun 29 08:46:31.811109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 511/972] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:31 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:31.823487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:31.824100 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:31.830335 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:31.830814 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:31.831585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:31.832018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:31.963141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:31.976962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:31.979465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:31.981358 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-199a6af7-bb15-44be-a01f-b050f5b02e0d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.161443 Jun 29 08:46:31.982231 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 462/973] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:31 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:32.827074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b6a8ac53-8a5b-4e27-9f2e-3bf4a9b65dd9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:32.827693 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b6a8ac53-8a5b-4e27-9f2e-3bf4a9b65dd9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:32.828799 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7f4538ab-b68b-48dc-a5bf-e852a225368d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:32.829415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7f4538ab-b68b-48dc-a5bf-e852a225368d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:32.829922 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:32.831333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:32.831746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:32.838043 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f4538ab-b68b-48dc-a5bf-e852a225368d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:32.838225 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6a8ac53-8a5b-4e27-9f2e-3bf4a9b65dd9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:32.838505 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f4538ab-b68b-48dc-a5bf-e852a225368d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:32.838662 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6a8ac53-8a5b-4e27-9f2e-3bf4a9b65dd9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:32.839310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f4538ab-b68b-48dc-a5bf-e852a225368d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:32.839764 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f4538ab-b68b-48dc-a5bf-e852a225368d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:32.840715 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6a8ac53-8a5b-4e27-9f2e-3bf4a9b65dd9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:32.841264 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6a8ac53-8a5b-4e27-9f2e-3bf4a9b65dd9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:32.861454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:33.034299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7f4538ab-b68b-48dc-a5bf-e852a225368d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:33.042111 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7f4538ab-b68b-48dc-a5bf-e852a225368d tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1366 microversion: 2.1 time: 0.218088 Jun 29 08:46:33.043129 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 463/974] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:32 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:33.048402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-3475ffd0-c25c-47e0-94bc-1d4332093760 req-4f9ed6e8-5294-4437-9354-088a1acd82b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd356b2c-5d79-440e-9710-0e7808621c28", "name": "network-vif-plugged", "status": "completed", "tag": "365adfee-4d17-44f7-9396-323504eaff0c"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:33.051205 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b6a8ac53-8a5b-4e27-9f2e-3bf4a9b65dd9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:33.057104 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-3475ffd0-c25c-47e0-94bc-1d4332093760 req-4f9ed6e8-5294-4437-9354-088a1acd82b3 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:33.057536 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-3475ffd0-c25c-47e0-94bc-1d4332093760 req-4f9ed6e8-5294-4437-9354-088a1acd82b3 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:33.059025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b6a8ac53-8a5b-4e27-9f2e-3bf4a9b65dd9 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.236305 Jun 29 08:46:33.059628 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 512/975] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:32 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:33.064221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:33.064817 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:33.069599 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-3475ffd0-c25c-47e0-94bc-1d4332093760 req-4f9ed6e8-5294-4437-9354-088a1acd82b3 service nova] Creating event network-vif-plugged:365adfee-4d17-44f7-9396-323504eaff0c for instance dd356b2c-5d79-440e-9710-0e7808621c28 on hv-cinder-79760 Jun 29 08:46:33.070684 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:33.071159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:33.071922 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:33.072351 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:33.074844 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-3475ffd0-c25c-47e0-94bc-1d4332093760 req-4f9ed6e8-5294-4437-9354-088a1acd82b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030402 Jun 29 08:46:33.075461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 464/976] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:33.210381 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:33.219542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:33.221063 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:33.222225 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1790bf2d-79a9-4971-9552-3a2963cf7e8b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.161682 Jun 29 08:46:33.222814 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 513/977] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:33 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:34.061198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-93b8faef-1218-4e6d-a1aa-61117438092c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:34.061878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-93b8faef-1218-4e6d-a1aa-61117438092c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:34.069788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-93b8faef-1218-4e6d-a1aa-61117438092c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:34.070256 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-93b8faef-1218-4e6d-a1aa-61117438092c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:34.071068 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-93b8faef-1218-4e6d-a1aa-61117438092c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:34.071552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-93b8faef-1218-4e6d-a1aa-61117438092c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:34.076451 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4edd3f0d-892a-4f87-92c7-3744b2d9c948 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:34.077073 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4edd3f0d-892a-4f87-92c7-3744b2d9c948 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:34.082587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=12 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:34.084962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4edd3f0d-892a-4f87-92c7-3744b2d9c948 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:34.085476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4edd3f0d-892a-4f87-92c7-3744b2d9c948 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:34.086546 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4edd3f0d-892a-4f87-92c7-3744b2d9c948 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:34.087455 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4edd3f0d-892a-4f87-92c7-3744b2d9c948 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:34.297919 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-93b8faef-1218-4e6d-a1aa-61117438092c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:34.302952 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4edd3f0d-892a-4f87-92c7-3744b2d9c948 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:34.305641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-93b8faef-1218-4e6d-a1aa-61117438092c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1366 microversion: 2.1 time: 0.249637 Jun 29 08:46:34.306225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 465/978] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:34 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:34.311471 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4edd3f0d-892a-4f87-92c7-3744b2d9c948 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.238932 Jun 29 08:46:34.312216 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 514/979] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:34 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:34.319891 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:34.320496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:34.326959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:34.327403 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:34.328542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:34.328977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:34.461442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:34.470093 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:34.471625 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:34.473201 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-07d580da-1940-4a39-a5e3-35a51db8ca0a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.156780 Jun 29 08:46:34.473645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 466/980] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:34 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:35.322942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f0683d3c-ddb8-4a7b-8eee-5909bcf2ee20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:35.323514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f0683d3c-ddb8-4a7b-8eee-5909bcf2ee20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:35.329224 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-81a30b0b-d11e-4b86-b20f-09fb9505eb2b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:35.329836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-81a30b0b-d11e-4b86-b20f-09fb9505eb2b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:35.331095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0683d3c-ddb8-4a7b-8eee-5909bcf2ee20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:35.331576 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0683d3c-ddb8-4a7b-8eee-5909bcf2ee20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:35.332469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0683d3c-ddb8-4a7b-8eee-5909bcf2ee20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:35.332677 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:35.332871 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0683d3c-ddb8-4a7b-8eee-5909bcf2ee20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:35.337734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-81a30b0b-d11e-4b86-b20f-09fb9505eb2b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:35.338264 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-81a30b0b-d11e-4b86-b20f-09fb9505eb2b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:35.339145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-81a30b0b-d11e-4b86-b20f-09fb9505eb2b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:35.339637 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-81a30b0b-d11e-4b86-b20f-09fb9505eb2b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:35.804390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-81a30b0b-d11e-4b86-b20f-09fb9505eb2b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:35.807671 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f0683d3c-ddb8-4a7b-8eee-5909bcf2ee20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:35.811983 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-81a30b0b-d11e-4b86-b20f-09fb9505eb2b tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.486625 Jun 29 08:46:35.812611 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 467/981] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:35 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:35.817342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:35.818025 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:35.821470 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f0683d3c-ddb8-4a7b-8eee-5909bcf2ee20 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1366 microversion: 2.1 time: 0.502537 Jun 29 08:46:35.822125 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 515/982] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:35 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1366 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:35.824016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:35.824463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:35.825216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:35.825644 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:35.974839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:35.986350 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:35.988308 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:35.989970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-51c19cf1-9561-4767-83ee-78ef71291140 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.176115 Jun 29 08:46:35.990504 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 468/983] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:35 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:36.829560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8c09d49e-2e58-4a18-b7c0-33264b14d51e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:36.830122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8c09d49e-2e58-4a18-b7c0-33264b14d51e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:36.837185 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c09d49e-2e58-4a18-b7c0-33264b14d51e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:36.837629 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c09d49e-2e58-4a18-b7c0-33264b14d51e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:36.838389 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c09d49e-2e58-4a18-b7c0-33264b14d51e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:36.838523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d4112d49-2194-4c26-a14c-07888b2a1106 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:36.839566 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c09d49e-2e58-4a18-b7c0-33264b14d51e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:36.839683 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d4112d49-2194-4c26-a14c-07888b2a1106 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:36.846737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d4112d49-2194-4c26-a14c-07888b2a1106 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:36.847197 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d4112d49-2194-4c26-a14c-07888b2a1106 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:36.847973 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d4112d49-2194-4c26-a14c-07888b2a1106 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:36.849192 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d4112d49-2194-4c26-a14c-07888b2a1106 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:37.034885 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8c09d49e-2e58-4a18-b7c0-33264b14d51e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:37.038928 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d4112d49-2194-4c26-a14c-07888b2a1106 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:37.046593 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d4112d49-2194-4c26-a14c-07888b2a1106 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1556 microversion: 2.1 time: 0.212003 Jun 29 08:46:37.047419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 469/984] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:36 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1556 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:37.047542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8c09d49e-2e58-4a18-b7c0-33264b14d51e tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.221652 Jun 29 08:46:37.049738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 516/985] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:36 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:37.052018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-bcc714ff-0fce-40b0-bda2-f213c775caf9 req-a126d3ec-2275-4b5e-9d6a-767f7b6b8cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbea51b8-1348-4834-badb-56258435cd06", "name": "network-vif-plugged", "status": "completed", "tag": "d7fdedc4-9082-4237-a3a6-f3fe54501c3f"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:37.054349 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:37.055127 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:37.060145 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-bcc714ff-0fce-40b0-bda2-f213c775caf9 req-a126d3ec-2275-4b5e-9d6a-767f7b6b8cc7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:37.060579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-bcc714ff-0fce-40b0-bda2-f213c775caf9 req-a126d3ec-2275-4b5e-9d6a-767f7b6b8cc7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:37.061275 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:37.061709 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:37.062458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:37.062913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:37.072476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-bcc714ff-0fce-40b0-bda2-f213c775caf9 req-a126d3ec-2275-4b5e-9d6a-767f7b6b8cc7 service nova] Creating event network-vif-plugged:d7fdedc4-9082-4237-a3a6-f3fe54501c3f for instance cbea51b8-1348-4834-badb-56258435cd06 on hv-cinder-79760 Jun 29 08:46:37.077442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-bcc714ff-0fce-40b0-bda2-f213c775caf9 req-a126d3ec-2275-4b5e-9d6a-767f7b6b8cc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029169 Jun 29 08:46:37.078433 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 470/986] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:37.083848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-166b4a29-bc1d-444a-a2b0-f70ea91b43b7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:37.084415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-166b4a29-bc1d-444a-a2b0-f70ea91b43b7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:37.090902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-166b4a29-bc1d-444a-a2b0-f70ea91b43b7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:37.091341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-166b4a29-bc1d-444a-a2b0-f70ea91b43b7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:37.092094 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-166b4a29-bc1d-444a-a2b0-f70ea91b43b7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:37.092516 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-166b4a29-bc1d-444a-a2b0-f70ea91b43b7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:37.200220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-166b4a29-bc1d-444a-a2b0-f70ea91b43b7 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120626 Jun 29 08:46:37.200781 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 471/987] 10.222.0.27 () {58 vars in 1274 bytes} [Wed Jun 29 08:46:37 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:37.232923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:37.237338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:37.242593 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:37.244322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:37.245483 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0600188c-ec65-4864-bcf8-e6cafa9eb1ee tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.196428 Jun 29 08:46:37.246244 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 517/988] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:37 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:38.065116 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6561a417-8a21-45c5-801a-337e3df08b86 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:38.065870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6561a417-8a21-45c5-801a-337e3df08b86 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:38.072099 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6561a417-8a21-45c5-801a-337e3df08b86 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:38.072543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6561a417-8a21-45c5-801a-337e3df08b86 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:38.073286 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6561a417-8a21-45c5-801a-337e3df08b86 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:38.073747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6561a417-8a21-45c5-801a-337e3df08b86 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:38.156306 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-a54e7ad7-dc84-4690-abd6-0f82c68bb271 req-1f1ad34b-49c9-4971-aa32-46256ca8dbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd356b2c-5d79-440e-9710-0e7808621c28", "tag": "365adfee-4d17-44f7-9396-323504eaff0c"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:38.166208 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a54e7ad7-dc84-4690-abd6-0f82c68bb271 req-1f1ad34b-49c9-4971-aa32-46256ca8dbe6 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:38.166593 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a54e7ad7-dc84-4690-abd6-0f82c68bb271 req-1f1ad34b-49c9-4971-aa32-46256ca8dbe6 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:38.178589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-a54e7ad7-dc84-4690-abd6-0f82c68bb271 req-1f1ad34b-49c9-4971-aa32-46256ca8dbe6 service nova] Creating event network-changed:365adfee-4d17-44f7-9396-323504eaff0c for instance dd356b2c-5d79-440e-9710-0e7808621c28 on hv-cinder-79760 Jun 29 08:46:38.183751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-a54e7ad7-dc84-4690-abd6-0f82c68bb271 req-1f1ad34b-49c9-4971-aa32-46256ca8dbe6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031429 Jun 29 08:46:38.184627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 518/989] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:38.216892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6561a417-8a21-45c5-801a-337e3df08b86 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:38.225437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6561a417-8a21-45c5-801a-337e3df08b86 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1573 microversion: 2.1 time: 0.164796 Jun 29 08:46:38.226014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 472/990] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:38 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:38.265788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:38.266521 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:38.273795 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:38.274312 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:38.275206 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:38.275640 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:38.463298 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:38.472743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:38.474320 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:38.475689 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-27a36a63-68b6-4885-a3c0-efb3660c288a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.214278 Jun 29 08:46:38.476261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 519/991] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:38 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:39.243211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1c36e9d2-2d60-4954-ab58-4cb33232e2e8 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:39.243924 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1c36e9d2-2d60-4954-ab58-4cb33232e2e8 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:39.251033 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c36e9d2-2d60-4954-ab58-4cb33232e2e8 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:39.251473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c36e9d2-2d60-4954-ab58-4cb33232e2e8 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:39.252245 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c36e9d2-2d60-4954-ab58-4cb33232e2e8 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:39.252674 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1c36e9d2-2d60-4954-ab58-4cb33232e2e8 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:39.387526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1c36e9d2-2d60-4954-ab58-4cb33232e2e8 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:39.396404 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1c36e9d2-2d60-4954-ab58-4cb33232e2e8 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1560 microversion: 2.1 time: 0.157131 Jun 29 08:46:39.396970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 473/992] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:46:39 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:46:39.497567 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:39.498192 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:39.505541 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:39.506090 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:39.507270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:39.507838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:39.657340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:39.666166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:39.667849 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:39.669037 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cfdcb399-32fd-4d04-81f0-da964d0e0ac3 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.177983 Jun 29 08:46:39.669585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 520/993] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:39 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:40.688559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:40.689171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:40.696410 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:40.696855 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:40.697610 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:40.698041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:40.841366 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:40.849585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:40.851105 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:40.852260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ea19560b-64f6-43aa-a269-7a3991286630 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1745 microversion: 2.20 time: 0.167742 Jun 29 08:46:40.852826 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 474/994] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:40 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:41.875202 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:41.876183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:41.884673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:41.885119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:41.886189 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:41.886305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:42.018619 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:42.026956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:42.028450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:42.029605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c31726a6-52bc-401c-817d-1e8b6ecd682b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1745 microversion: 2.20 time: 0.160801 Jun 29 08:46:42.030168 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 521/995] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:41 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:42.998539 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-382671de-1a38-4e70-9888-27c647332130 req-6826dc62-3cab-4474-b64f-734d0b8f689c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f64cb6c-8320-480e-b79c-bb55a51513b8", "name": "network-vif-plugged", "status": "completed", "tag": "0a7a70f1-09de-40ce-b9fe-437390cf5dab"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:43.010455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-382671de-1a38-4e70-9888-27c647332130 req-6826dc62-3cab-4474-b64f-734d0b8f689c service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:43.011289 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-382671de-1a38-4e70-9888-27c647332130 req-6826dc62-3cab-4474-b64f-734d0b8f689c service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:43.024653 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-382671de-1a38-4e70-9888-27c647332130 req-6826dc62-3cab-4474-b64f-734d0b8f689c service nova] Creating event network-vif-plugged:0a7a70f1-09de-40ce-b9fe-437390cf5dab for instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 on hv-cinder-79760 Jun 29 08:46:43.029660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-382671de-1a38-4e70-9888-27c647332130 req-6826dc62-3cab-4474-b64f-734d0b8f689c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035036 Jun 29 08:46:43.030560 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 475/996] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:43.049652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:43.050256 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:43.057583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:43.058015 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:43.058809 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:43.059238 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:43.191516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:43.199848 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:43.201337 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:43.202483 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-98b02397-eb81-46f0-a27e-cc3b82bf9621 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1745 microversion: 2.20 time: 0.156913 Jun 29 08:46:43.203091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 522/997] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:43 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:44.225562 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:44.226239 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:44.233285 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:44.233733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:44.234503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:44.235003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:44.388052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:44.400648 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:44.403128 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:44.404910 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-266198b9-810f-485f-8714-4d96e2f6984f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1745 microversion: 2.20 time: 0.185839 Jun 29 08:46:44.405720 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 476/998] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:44 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:45.429405 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:45.430098 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:45.438230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:45.438752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:45.439677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:45.440177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:45.574590 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:45.587476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:45.589857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:45.592037 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f3b84bff-19a8-4a1a-a958-6745e849a286 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1745 microversion: 2.20 time: 0.169153 Jun 29 08:46:45.592840 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 523/999] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:45 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:46.613374 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:46.614006 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:46.622158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:46.622607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:46.623412 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:46.623839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:46.981293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:46.989999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:46.991664 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:46.993220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5fe39509-c048-4f39-b77f-180f908c8f28 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.383505 Jun 29 08:46:46.993648 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 477/1000] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:46 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:48.012091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:48.012708 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:48.021642 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:48.022399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:48.023363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:48.024085 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:48.160772 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:48.169268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:48.170797 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:48.171955 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-494f8d73-d2bd-4fff-b330-8e2b7069ee7b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.164448 Jun 29 08:46:48.172520 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 524/1001] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:48 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:49.190839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:49.191456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:49.198639 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:49.199112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:49.199891 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:49.200316 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:49.358142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:49.366324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:49.367932 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:49.369088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1d1c9fe9-926e-4356-a495-0c048e314c3a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.182510 Jun 29 08:46:49.369630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 478/1002] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:49 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:50.323295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-122afea9-d633-4661-99a2-c740f55aa58b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:50.324439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-122afea9-d633-4661-99a2-c740f55aa58b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:50.331376 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-122afea9-d633-4661-99a2-c740f55aa58b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:50.332072 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-122afea9-d633-4661-99a2-c740f55aa58b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:50.333114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-122afea9-d633-4661-99a2-c740f55aa58b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:50.333578 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-122afea9-d633-4661-99a2-c740f55aa58b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:50.359756 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-122afea9-d633-4661-99a2-c740f55aa58b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/ips" status: 200 len: 146 microversion: 2.1 time: 0.041162 Jun 29 08:46:50.360480 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 525/1003] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:46:50 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:46:50.387648 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:50.388246 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:50.395064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:50.395498 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:50.396251 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:50.396672 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:50.541240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:50.549234 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:50.550722 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:50.551913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a66fa26c-f422-4e1c-a47b-be531b99e4a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.168182 Jun 29 08:46:50.552649 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 479/1004] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:50 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:51.570365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:51.571122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:51.578923 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:51.579371 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:51.580140 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:51.580738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:51.730480 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:51.739311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:51.741506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:51.743093 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6ea924d0-75f1-4d7a-9522-e792d56c3cfd tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.176710 Jun 29 08:46:51.743809 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 526/1005] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:51 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:52.523726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-28324c05-a8da-407e-b655-3d74e1bb452f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc86a6e8-85e5-469d-8c24-2560347b26eb"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:46:52.524702 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-28324c05-a8da-407e-b655-3d74e1bb452f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:52.532666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-28324c05-a8da-407e-b655-3d74e1bb452f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:52.533363 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-28324c05-a8da-407e-b655-3d74e1bb452f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:52.534132 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-28324c05-a8da-407e-b655-3d74e1bb452f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:52.534591 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-28324c05-a8da-407e-b655-3d74e1bb452f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:52.761943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:52.763538 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:52.776029 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:52.776463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:52.777457 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:52.778047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:52.833501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-28324c05-a8da-407e-b655-3d74e1bb452f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314173 Jun 29 08:46:52.834517 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 480/1006] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:46:52 2022] POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:46:52.961386 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:52.971284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:52.972832 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:52.974201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec039b2e-0f5e-4ac9-87fa-81871f510430 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.216597 Jun 29 08:46:52.974980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 527/1007] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:52 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:46:53.993847 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:53.994740 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:54.004540 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:54.005140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:54.006039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:54.006568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:54.022488 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:46:54.147977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:54.157227 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:54.158937 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:54.160226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4b03d87c-e4f4-499c-9ba9-aa0632425d58 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.171038 Jun 29 08:46:54.161346 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 481/1008] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:53 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:55.179546 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:55.180162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:55.187331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:55.187974 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:55.188947 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:55.189651 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:55.548223 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:55.556700 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:55.558351 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:55.559642 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0313cc25-783c-44ce-b62d-a1f21f06752a tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.384550 Jun 29 08:46:55.560738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 528/1009] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:55 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:56.582562 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:56.583686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:56.591801 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:56.592237 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:56.592985 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:56.593410 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:56.739388 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:56.747947 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:56.749462 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:56.750627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c1969ddc-cc63-4a1b-8da4-b78be1da40ed tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1740 microversion: 2.20 time: 0.174635 Jun 29 08:46:56.751397 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 482/1010] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:56 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:57.773604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:57.774470 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:57.785318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:57.786039 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:57.787331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:57.788122 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:57.924536 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:57.932670 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:57.934138 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:57.935319 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-90cb2661-85c9-4ae6-bfb0-87e0de13d6eb tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1722 microversion: 2.20 time: 0.168359 Jun 29 08:46:57.935867 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 529/1011] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:57 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:46:58.957565 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:46:58.958594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:46:58.966396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:58.966869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:58.967630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:46:58.968057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:46:59.110946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:59.119364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:59.120849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:46:59.121997 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ef161cdb-37ca-45a0-85db-af4b9820b53f tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1722 microversion: 2.20 time: 0.171101 Jun 29 08:46:59.122553 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 483/1012] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:46:58 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:00.143971 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:00.144855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:00.153401 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:00.153839 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:00.154587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:00.155049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:00.290010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:00.303134 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:00.305536 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:00.306717 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3540d54c-4f13-496e-a798-ea8b71be3c02 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1722 microversion: 2.20 time: 0.168796 Jun 29 08:47:00.307308 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 530/1013] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:00 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:01.329364 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:01.330324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:01.341602 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:01.342340 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:01.343637 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:01.344345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:01.483831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:01.492274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:01.494018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:01.495225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-79e2bf47-986b-4ac2-83bb-19a4ead9c17c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1722 microversion: 2.20 time: 0.172379 Jun 29 08:47:01.495780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 484/1014] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:01 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:01.593154 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-455e686d-5669-4c7f-967a-19fd6908c495 req-073dad90-e743-4e0e-bba6-be6fd40bb231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f64cb6c-8320-480e-b79c-bb55a51513b8", "name": "network-vif-unplugged", "status": "completed", "tag": "0a7a70f1-09de-40ce-b9fe-437390cf5dab"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:01.601937 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-455e686d-5669-4c7f-967a-19fd6908c495 req-073dad90-e743-4e0e-bba6-be6fd40bb231 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:01.602435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-455e686d-5669-4c7f-967a-19fd6908c495 req-073dad90-e743-4e0e-bba6-be6fd40bb231 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:01.615025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-455e686d-5669-4c7f-967a-19fd6908c495 req-073dad90-e743-4e0e-bba6-be6fd40bb231 service nova] Creating event network-vif-unplugged:0a7a70f1-09de-40ce-b9fe-437390cf5dab for instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 on hv-cinder-79760 Jun 29 08:47:01.620271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-455e686d-5669-4c7f-967a-19fd6908c495 req-073dad90-e743-4e0e-bba6-be6fd40bb231 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031182 Jun 29 08:47:01.620869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 531/1015] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:47:02.514930 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:02.515574 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:02.523052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:02.523941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:02.524964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:02.525706 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:02.678479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:02.687153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:02.688653 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:02.689813 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-246c7d1d-f908-4ada-8f96-14caae8fbc2c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1722 microversion: 2.20 time: 0.179467 Jun 29 08:47:02.690365 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 485/1016] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:02 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:03.581224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-be9b5c10-ea34-4e35-be65-fe3103973d58 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:03.583735 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=40 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:03.590190 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be9b5c10-ea34-4e35-be65-fe3103973d58 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:03.590606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be9b5c10-ea34-4e35-be65-fe3103973d58 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:03.650719 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-be9b5c10-ea34-4e35-be65-fe3103973d58 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Going to try to stop instance {{(pid=124266) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 08:47:03.697204 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-be9b5c10-ea34-4e35-be65-fe3103973d58 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/action" status: 202 len: 0 microversion: 2.1 time: 0.120017 Jun 29 08:47:03.698061 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 532/1017] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:47:03 2022] POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:47:03.707326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1e841fe0-e763-431e-91c7-353a0c6019b6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:03.707937 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1e841fe0-e763-431e-91c7-353a0c6019b6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:03.708095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:03.708631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:03.716402 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:03.716780 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:03.716920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1e841fe0-e763-431e-91c7-353a0c6019b6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:03.717582 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:03.717726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1e841fe0-e763-431e-91c7-353a0c6019b6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:03.718010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:03.718501 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1e841fe0-e763-431e-91c7-353a0c6019b6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:03.718946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1e841fe0-e763-431e-91c7-353a0c6019b6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:03.920352 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-1e841fe0-e763-431e-91c7-353a0c6019b6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:03.923203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:03.928532 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1e841fe0-e763-431e-91c7-353a0c6019b6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.226084 Jun 29 08:47:03.929131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 486/1018] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:03 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:47:03.931593 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:03.933081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:03.934234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fae4aa2a-629d-46df-9e22-b83c07e305c5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1665 microversion: 2.20 time: 0.230597 Jun 29 08:47:03.934780 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 533/1019] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:03 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1665 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:03.951629 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-09c933a8-7c9a-49a3-a277-32b36d08cc9e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06d9ecb0-e8b2-4c05-a380-6cb4a4eb3d82"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:03.952843 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-09c933a8-7c9a-49a3-a277-32b36d08cc9e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:03.959034 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09c933a8-7c9a-49a3-a277-32b36d08cc9e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:03.959479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09c933a8-7c9a-49a3-a277-32b36d08cc9e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:03.960232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09c933a8-7c9a-49a3-a277-32b36d08cc9e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:03.960663 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-09c933a8-7c9a-49a3-a277-32b36d08cc9e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.275038 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-09c933a8-7c9a-49a3-a277-32b36d08cc9e tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327171 Jun 29 08:47:04.275659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 487/1020] 10.222.0.27 () {62 vars in 1363 bytes} [Wed Jun 29 08:47:03 2022] POST /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:47:04.399531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-451ccc0f-8639-4978-942d-38e643223fc7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:04.400020 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-451ccc0f-8639-4978-942d-38e643223fc7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:04.408342 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-451ccc0f-8639-4978-942d-38e643223fc7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:04.408966 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-451ccc0f-8639-4978-942d-38e643223fc7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.410068 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-451ccc0f-8639-4978-942d-38e643223fc7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:04.410614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-451ccc0f-8639-4978-942d-38e643223fc7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.506125 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:04.681396 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-451ccc0f-8639-4978-942d-38e643223fc7 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/os-volume_attachments/06d9ecb0-e8b2-4c05-a380-6cb4a4eb3d82" status: 202 len: 0 microversion: 2.20 time: 0.285808 Jun 29 08:47:04.682056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 534/1021] 10.222.0.27 () {60 vars in 1456 bytes} [Wed Jun 29 08:47:04 2022] DELETE /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/os-volume_attachments/06d9ecb0-e8b2-4c05-a380-6cb4a4eb3d82 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:47:04.741395 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-02f588d0-c3ed-4a18-8e17-65b6b07d5109 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:04.742596 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-02f588d0-c3ed-4a18-8e17-65b6b07d5109 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:04.749482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-02f588d0-c3ed-4a18-8e17-65b6b07d5109 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:04.749920 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-02f588d0-c3ed-4a18-8e17-65b6b07d5109 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.750670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-02f588d0-c3ed-4a18-8e17-65b6b07d5109 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:04.751127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-02f588d0-c3ed-4a18-8e17-65b6b07d5109 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.831729 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-02f588d0-c3ed-4a18-8e17-65b6b07d5109 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "POST /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/action" status: 202 len: 0 microversion: 2.20 time: 0.094311 Jun 29 08:47:04.832585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 488/1022] 10.222.0.27 () {62 vars in 1318 bytes} [Wed Jun 29 08:47:04 2022] POST /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:47:04.841687 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:04.842292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:04.850177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:04.850626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.851422 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:04.851898 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.945751 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4a1fad85-dd3b-4bbb-b006-f0e529ebfc6f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:04.946789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4a1fad85-dd3b-4bbb-b006-f0e529ebfc6f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:04.955004 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a1fad85-dd3b-4bbb-b006-f0e529ebfc6f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:04.955561 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a1fad85-dd3b-4bbb-b006-f0e529ebfc6f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.956435 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a1fad85-dd3b-4bbb-b006-f0e529ebfc6f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:04.956944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a1fad85-dd3b-4bbb-b006-f0e529ebfc6f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:04.987066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:04.996037 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:04.997271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:04.998452 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7e582dbb-fb6d-4775-8f58-faa4fc11c053 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1673 microversion: 2.20 time: 0.161237 Jun 29 08:47:04.999031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 535/1023] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:04 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:05.103686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4a1fad85-dd3b-4bbb-b006-f0e529ebfc6f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:05.112342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4a1fad85-dd3b-4bbb-b006-f0e529ebfc6f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.170444 Jun 29 08:47:05.113117 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 489/1024] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:04 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:06.022006 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:06.023012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:06.031346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:06.031768 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:06.032538 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:06.032969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:06.129689 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bdab7a2a-ef33-4e27-84ad-a5f7e3053fcf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:06.130320 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bdab7a2a-ef33-4e27-84ad-a5f7e3053fcf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:06.132721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=48 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:06.138465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdab7a2a-ef33-4e27-84ad-a5f7e3053fcf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:06.138945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdab7a2a-ef33-4e27-84ad-a5f7e3053fcf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:06.139726 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdab7a2a-ef33-4e27-84ad-a5f7e3053fcf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:06.140162 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bdab7a2a-ef33-4e27-84ad-a5f7e3053fcf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:06.265477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:06.273861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:06.275339 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:06.276649 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d6b7c9e4-03f9-40e6-bc23-395e873f31c8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.261504 Jun 29 08:47:06.277197 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 536/1025] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:06 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:06.365216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bdab7a2a-ef33-4e27-84ad-a5f7e3053fcf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:06.374163 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bdab7a2a-ef33-4e27-84ad-a5f7e3053fcf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.248433 Jun 29 08:47:06.374724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 490/1026] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:06 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:07.296857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:07.297746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:07.314512 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:07.314981 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:07.315776 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:07.316201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:07.391878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-142a196d-d8b7-497d-817a-9eff849fb1f5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:07.392595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-142a196d-d8b7-497d-817a-9eff849fb1f5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:07.399247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-142a196d-d8b7-497d-817a-9eff849fb1f5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:07.399754 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-142a196d-d8b7-497d-817a-9eff849fb1f5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:07.400603 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-142a196d-d8b7-497d-817a-9eff849fb1f5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:07.401066 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-142a196d-d8b7-497d-817a-9eff849fb1f5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:07.504542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:07.517980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:07.519970 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:07.521384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e1d5649e-40a1-4169-9ec4-4c8f28a4cf17 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.229428 Jun 29 08:47:07.523007 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 537/1027] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:07 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:07.572886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-142a196d-d8b7-497d-817a-9eff849fb1f5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:07.583492 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-142a196d-d8b7-497d-817a-9eff849fb1f5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.195274 Jun 29 08:47:07.584342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 491/1028] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:07 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:47:08.543338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:08.544812 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:08.553869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:08.554487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:08.555614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:08.556218 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:08.601454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-50f80c4c-f0f9-448b-a207-994d93deca7d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:08.602070 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-50f80c4c-f0f9-448b-a207-994d93deca7d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:08.609923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50f80c4c-f0f9-448b-a207-994d93deca7d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:08.610958 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50f80c4c-f0f9-448b-a207-994d93deca7d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:08.611748 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50f80c4c-f0f9-448b-a207-994d93deca7d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:08.615404 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50f80c4c-f0f9-448b-a207-994d93deca7d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:08.769606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:08.781726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:08.783537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:08.786995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1d476856-7333-42da-a70b-fc27a9bcf9a1 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.247034 Jun 29 08:47:08.787733 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 538/1029] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:08 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:08.795729 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-50f80c4c-f0f9-448b-a207-994d93deca7d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:08.808790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-50f80c4c-f0f9-448b-a207-994d93deca7d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.210973 Jun 29 08:47:08.809377 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 492/1030] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:08 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:09.108656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1099920507", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1732324740", "security_groups": [{"name": "tempest-secgroup-smoke-633675277"}], "block_device_mapping_v2": [{"uuid": "a66e1851-47eb-4130-9304-e22ffe22264e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "95cdc108-572d-40ee-b588-3458605e5b77"}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:09.227773 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] validate_networks() for [('95cdc108-572d-40ee-b588-3458605e5b77', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:47:09.620064 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:47:09.620827 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:47:09.620986 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:47:09.621333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:47:09.621736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:47:09.631609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:09.632046 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:09.632828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:09.633250 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:09.650161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Getting quotas for project fa6da3e4a87442299d21f3b55dfe3e9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:47:09.654328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Getting quotas for user 1b2337595cbb40608d6bc485889d8bc6 and project fa6da3e4a87442299d21f3b55dfe3e9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:47:09.729921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:47:09.732166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a66e1851-47eb-4130-9304-e22ffe22264e',volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:47:09.806003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:09.807554 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:09.815048 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:09.815756 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:09.816669 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:09.817260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:09.903452 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec16c223-6e5f-4c65-a2d1-317c0fa2022d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.798889 Jun 29 08:47:09.909499 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 539/1031] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:47:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:47:09.910000 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-40ea61c1-cc36-41b5-a68f-7ef4605f3dbc tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:09.911046 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-40ea61c1-cc36-41b5-a68f-7ef4605f3dbc tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:09.918636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-40ea61c1-cc36-41b5-a68f-7ef4605f3dbc tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:09.919106 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-40ea61c1-cc36-41b5-a68f-7ef4605f3dbc tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:09.920220 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-40ea61c1-cc36-41b5-a68f-7ef4605f3dbc tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:09.920337 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-40ea61c1-cc36-41b5-a68f-7ef4605f3dbc tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:10.073824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:10.083018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:10.084493 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:10.085667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-63500391-fe2c-42d8-9ae5-c75c74dc3603 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.284683 Jun 29 08:47:10.086499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 493/1032] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:09 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:10.103259 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7bf2e0c3-e310-4c62-b367-b799e79facc4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:10.104070 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-40ea61c1-cc36-41b5-a68f-7ef4605f3dbc tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:10.104209 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7bf2e0c3-e310-4c62-b367-b799e79facc4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:10.113496 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-40ea61c1-cc36-41b5-a68f-7ef4605f3dbc tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.207899 Jun 29 08:47:10.114426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 540/1033] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:09 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:10.177353 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7bf2e0c3-e310-4c62-b367-b799e79facc4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:10.185127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7bf2e0c3-e310-4c62-b367-b799e79facc4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1095 microversion: 2.1 time: 0.096757 Jun 29 08:47:10.186026 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 494/1034] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:10 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:11.105230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:11.106752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:11.116586 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:11.117057 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:11.117845 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:11.118274 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:11.131584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4aca18fe-2579-4310-847a-347134cf3ee9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:11.132976 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4aca18fe-2579-4310-847a-347134cf3ee9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:11.143675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4aca18fe-2579-4310-847a-347134cf3ee9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:11.144275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4aca18fe-2579-4310-847a-347134cf3ee9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:11.145239 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4aca18fe-2579-4310-847a-347134cf3ee9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:11.145906 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4aca18fe-2579-4310-847a-347134cf3ee9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:11.150383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:11.371805 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:11.381334 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:11.382884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:11.384216 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d84f11fe-a631-4b8d-a3c0-edb41f33488c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.283195 Jun 29 08:47:11.384338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4aca18fe-2579-4310-847a-347134cf3ee9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:11.384773 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 541/1035] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:11 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:11.393831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-92bed09d-1e32-47a9-a9be-fb3006717367 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:11.393831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-92bed09d-1e32-47a9-a9be-fb3006717367 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:11.394158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4aca18fe-2579-4310-847a-347134cf3ee9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.265418 Jun 29 08:47:11.394158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 495/1036] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:11 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:11.402767 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92bed09d-1e32-47a9-a9be-fb3006717367 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:11.403326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92bed09d-1e32-47a9-a9be-fb3006717367 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:11.404177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92bed09d-1e32-47a9-a9be-fb3006717367 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:11.404680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92bed09d-1e32-47a9-a9be-fb3006717367 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:11.476324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-92bed09d-1e32-47a9-a9be-fb3006717367 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:11.486362 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-92bed09d-1e32-47a9-a9be-fb3006717367 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1145 microversion: 2.1 time: 0.100405 Jun 29 08:47:11.486899 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 542/1037] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:11 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1145 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:12.406976 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:12.407606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:12.409962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5262438f-9033-4608-be70-c80eef3b1425 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:12.410566 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5262438f-9033-4608-be70-c80eef3b1425 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:12.414465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:12.414952 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:12.415861 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:12.416366 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:12.420680 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5262438f-9033-4608-be70-c80eef3b1425 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:12.421170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5262438f-9033-4608-be70-c80eef3b1425 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:12.421925 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5262438f-9033-4608-be70-c80eef3b1425 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:12.422385 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5262438f-9033-4608-be70-c80eef3b1425 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:12.625858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5262438f-9033-4608-be70-c80eef3b1425 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:12.632348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:12.634657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5262438f-9033-4608-be70-c80eef3b1425 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.228459 Jun 29 08:47:12.635261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 543/1038] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:12 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:12.640929 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:12.641125 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-22dc87b5-b751-4e5b-88da-3631850735c0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:12.641577 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-22dc87b5-b751-4e5b-88da-3631850735c0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:12.642551 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:12.643834 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6d8c65cd-5eac-4673-87b8-f17968e73201 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.240940 Jun 29 08:47:12.644383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 496/1039] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:12 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:47:12.652985 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22dc87b5-b751-4e5b-88da-3631850735c0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:12.653882 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22dc87b5-b751-4e5b-88da-3631850735c0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:12.654730 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22dc87b5-b751-4e5b-88da-3631850735c0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:12.655166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22dc87b5-b751-4e5b-88da-3631850735c0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:12.721667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-22dc87b5-b751-4e5b-88da-3631850735c0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:12.729546 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-22dc87b5-b751-4e5b-88da-3631850735c0 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1145 microversion: 2.1 time: 0.092909 Jun 29 08:47:12.730039 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 544/1040] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:12 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:13.652457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-eec1cf31-8f3d-41a0-ace1-e863a558c313 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:13.653374 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-eec1cf31-8f3d-41a0-ace1-e863a558c313 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:13.660972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eec1cf31-8f3d-41a0-ace1-e863a558c313 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:13.661485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eec1cf31-8f3d-41a0-ace1-e863a558c313 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:13.662119 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eec1cf31-8f3d-41a0-ace1-e863a558c313 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:13.662832 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eec1cf31-8f3d-41a0-ace1-e863a558c313 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:13.662964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:13.663404 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:13.671843 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:13.672270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:13.673035 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:13.673461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:13.888221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:13.891169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-eec1cf31-8f3d-41a0-ace1-e863a558c313 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:13.898520 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:13.900102 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:13.900756 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-eec1cf31-8f3d-41a0-ace1-e863a558c313 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.252248 Jun 29 08:47:13.901340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-57837c28-7684-4ad2-bbb6-506aa86da878 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.242697 Jun 29 08:47:13.906856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 497/1041] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:13 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:13.910607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-874a8ccd-c755-4f46-9b46-925dbfa1b63e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:13.915277 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 545/1042] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:13 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:13.920817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-874a8ccd-c755-4f46-9b46-925dbfa1b63e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:13.927172 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-874a8ccd-c755-4f46-9b46-925dbfa1b63e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:13.927646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-874a8ccd-c755-4f46-9b46-925dbfa1b63e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:13.928415 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-874a8ccd-c755-4f46-9b46-925dbfa1b63e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:13.928872 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-874a8ccd-c755-4f46-9b46-925dbfa1b63e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:13.992174 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-874a8ccd-c755-4f46-9b46-925dbfa1b63e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:13.999951 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-874a8ccd-c755-4f46-9b46-925dbfa1b63e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1145 microversion: 2.1 time: 0.097000 Jun 29 08:47:14.000902 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 498/1043] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:13 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:14.919209 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6bd6d95b-cf45-4a3e-8ab9-69e799509ec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:14.920044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6bd6d95b-cf45-4a3e-8ab9-69e799509ec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:14.923427 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:14.924150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:14.926626 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6bd6d95b-cf45-4a3e-8ab9-69e799509ec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:14.927159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6bd6d95b-cf45-4a3e-8ab9-69e799509ec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:14.928245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6bd6d95b-cf45-4a3e-8ab9-69e799509ec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:14.928667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6bd6d95b-cf45-4a3e-8ab9-69e799509ec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:14.931082 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:14.931687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:14.932482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:14.932915 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:15.139957 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6bd6d95b-cf45-4a3e-8ab9-69e799509ec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:15.152228 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:15.155478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6bd6d95b-cf45-4a3e-8ab9-69e799509ec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.241665 Jun 29 08:47:15.161968 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:15.163531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:15.163673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 546/1044] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:14 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:15.164715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5aff6407-4a38-4526-999b-5f56e59ff462 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.246002 Jun 29 08:47:15.175984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 499/1045] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:14 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:15.176197 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3dd2c9ad-2b93-4ab2-be67-5f1a9eb80a0b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:15.176197 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3dd2c9ad-2b93-4ab2-be67-5f1a9eb80a0b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:15.179912 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3dd2c9ad-2b93-4ab2-be67-5f1a9eb80a0b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:15.180370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3dd2c9ad-2b93-4ab2-be67-5f1a9eb80a0b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:15.181146 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3dd2c9ad-2b93-4ab2-be67-5f1a9eb80a0b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:15.181574 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3dd2c9ad-2b93-4ab2-be67-5f1a9eb80a0b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:15.248969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3dd2c9ad-2b93-4ab2-be67-5f1a9eb80a0b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:15.257062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3dd2c9ad-2b93-4ab2-be67-5f1a9eb80a0b tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1145 microversion: 2.1 time: 0.092113 Jun 29 08:47:15.262418 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 547/1046] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:15 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:16.182199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8a560c4c-3784-4d3e-924e-5bc17d6e2959 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:16.184105 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8a560c4c-3784-4d3e-924e-5bc17d6e2959 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:16.189222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:16.189222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:16.194427 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:16.194906 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:16.195692 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:16.196126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:16.196498 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8a560c4c-3784-4d3e-924e-5bc17d6e2959 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:16.196940 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8a560c4c-3784-4d3e-924e-5bc17d6e2959 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:16.197673 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8a560c4c-3784-4d3e-924e-5bc17d6e2959 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:16.198094 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8a560c4c-3784-4d3e-924e-5bc17d6e2959 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:16.395784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8a560c4c-3784-4d3e-924e-5bc17d6e2959 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:16.403768 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:16.405112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8a560c4c-3784-4d3e-924e-5bc17d6e2959 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.227365 Jun 29 08:47:16.406441 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 500/1047] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:16 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:16.414095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:16.414329 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c6694619-ee04-4fda-90b3-03b05638e0e4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:16.415012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c6694619-ee04-4fda-90b3-03b05638e0e4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:16.416335 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:16.417744 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f83eeeaf-7a5e-4fac-9065-2d0d9939e13d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.235380 Jun 29 08:47:16.418947 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 548/1048] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:16 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:16.421938 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c6694619-ee04-4fda-90b3-03b05638e0e4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:16.422579 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c6694619-ee04-4fda-90b3-03b05638e0e4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:16.423595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c6694619-ee04-4fda-90b3-03b05638e0e4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:16.424121 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c6694619-ee04-4fda-90b3-03b05638e0e4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:16.488755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c6694619-ee04-4fda-90b3-03b05638e0e4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:16.495814 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c6694619-ee04-4fda-90b3-03b05638e0e4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1145 microversion: 2.1 time: 0.088859 Jun 29 08:47:16.496569 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 501/1049] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:16 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:17.426988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-652c6743-b376-4186-a709-7386048d931f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:17.427664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-652c6743-b376-4186-a709-7386048d931f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:17.435572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-652c6743-b376-4186-a709-7386048d931f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:17.436016 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-652c6743-b376-4186-a709-7386048d931f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:17.436577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:17.437075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-652c6743-b376-4186-a709-7386048d931f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:17.437175 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:17.437267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-652c6743-b376-4186-a709-7386048d931f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:17.444155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:17.444571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:17.445335 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:17.445746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:17.908965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-652c6743-b376-4186-a709-7386048d931f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:17.912295 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:17.917186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-652c6743-b376-4186-a709-7386048d931f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.496459 Jun 29 08:47:17.917731 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 549/1050] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:17 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:17.922000 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:17.922411 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ca502517-39bf-4d01-8e76-8e867c2deae4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:17.923072 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ca502517-39bf-4d01-8e76-8e867c2deae4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:17.923533 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:17.924697 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-335bf5ce-14ec-4d73-9713-4418ff27adbf tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.492071 Jun 29 08:47:17.925447 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 502/1051] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:17 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:47:17.928975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca502517-39bf-4d01-8e76-8e867c2deae4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:17.929398 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca502517-39bf-4d01-8e76-8e867c2deae4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:17.930150 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca502517-39bf-4d01-8e76-8e867c2deae4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:17.930576 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca502517-39bf-4d01-8e76-8e867c2deae4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:17.934736 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:17.992753 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ca502517-39bf-4d01-8e76-8e867c2deae4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:18.000775 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ca502517-39bf-4d01-8e76-8e867c2deae4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1145 microversion: 2.1 time: 0.082006 Jun 29 08:47:18.001734 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 550/1052] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:17 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:18.938853 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-904ef0de-4f87-47c1-ab79-8953fdb040aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:18.939900 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-904ef0de-4f87-47c1-ab79-8953fdb040aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:18.947784 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:18.948774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:18.950600 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-904ef0de-4f87-47c1-ab79-8953fdb040aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:18.951111 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-904ef0de-4f87-47c1-ab79-8953fdb040aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:18.951876 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-904ef0de-4f87-47c1-ab79-8953fdb040aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:18.952307 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-904ef0de-4f87-47c1-ab79-8953fdb040aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:18.955709 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:18.956144 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:18.956888 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:18.957311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:19.147706 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-904ef0de-4f87-47c1-ab79-8953fdb040aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:19.150741 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:19.156282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-904ef0de-4f87-47c1-ab79-8953fdb040aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.224029 Jun 29 08:47:19.157084 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 503/1053] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:18 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:19.159744 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:19.161246 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-860071c4-4caa-47aa-adde-c81f038848f4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:19.161359 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:19.161857 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-860071c4-4caa-47aa-adde-c81f038848f4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:19.162413 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-90cb0ffc-10db-4036-91f1-fd2fcef71288 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.221231 Jun 29 08:47:19.163157 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 551/1054] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:18 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:47:19.167696 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-860071c4-4caa-47aa-adde-c81f038848f4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:19.168140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-860071c4-4caa-47aa-adde-c81f038848f4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:19.168903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-860071c4-4caa-47aa-adde-c81f038848f4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:19.169324 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-860071c4-4caa-47aa-adde-c81f038848f4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:19.232632 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-860071c4-4caa-47aa-adde-c81f038848f4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:19.240146 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-860071c4-4caa-47aa-adde-c81f038848f4 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1145 microversion: 2.1 time: 0.082351 Jun 29 08:47:19.240704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 504/1055] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:19 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:20.175540 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-79663782-dde1-482f-b018-3f4d3471490b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:20.176370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-79663782-dde1-482f-b018-3f4d3471490b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:20.179048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:20.179779 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:20.181036 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:20.181720 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:20.184482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:20.187384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79663782-dde1-482f-b018-3f4d3471490b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:20.187828 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79663782-dde1-482f-b018-3f4d3471490b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:20.188600 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79663782-dde1-482f-b018-3f4d3471490b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:20.189030 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79663782-dde1-482f-b018-3f4d3471490b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:20.190117 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:20.190558 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:20.191341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:20.191762 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:20.385772 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:20.389040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-79663782-dde1-482f-b018-3f4d3471490b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:20.394221 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:20.395893 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:20.397105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-79663782-dde1-482f-b018-3f4d3471490b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1722 microversion: 2.1 time: 0.226530 Jun 29 08:47:20.397260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c72b9792-86e9-4e85-b7ef-7e036392a05b tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.220237 Jun 29 08:47:20.397650 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 552/1056] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:20 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:20.399195 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 505/1057] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:20 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:20.402081 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2e59ea03-6082-4227-b709-43dff7c35ddd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:20.403031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2e59ea03-6082-4227-b709-43dff7c35ddd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:20.409224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2e59ea03-6082-4227-b709-43dff7c35ddd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:20.409844 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2e59ea03-6082-4227-b709-43dff7c35ddd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:20.411061 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2e59ea03-6082-4227-b709-43dff7c35ddd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:20.411706 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2e59ea03-6082-4227-b709-43dff7c35ddd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:20.484806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2e59ea03-6082-4227-b709-43dff7c35ddd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:20.492426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2e59ea03-6082-4227-b709-43dff7c35ddd tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1145 microversion: 2.1 time: 0.093811 Jun 29 08:47:20.492992 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 553/1058] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:20 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:21.413878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-45e34a04-2124-49dc-a158-dfed3c18865e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:21.414584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-45e34a04-2124-49dc-a158-dfed3c18865e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:21.415853 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:21.416511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:21.422010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-45e34a04-2124-49dc-a158-dfed3c18865e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.422461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-45e34a04-2124-49dc-a158-dfed3c18865e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.423572 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-45e34a04-2124-49dc-a158-dfed3c18865e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.423752 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-45e34a04-2124-49dc-a158-dfed3c18865e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.424009 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.424333 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.425093 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.425513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.621369 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-45e34a04-2124-49dc-a158-dfed3c18865e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:21.624651 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:21.629824 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-45e34a04-2124-49dc-a158-dfed3c18865e tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1699 microversion: 2.1 time: 0.220191 Jun 29 08:47:21.630483 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 506/1059] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:21 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1699 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:21.632781 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:21.634215 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:21.635182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9448afc8-4e73-4c96-bc39-6e2288621d9a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:21.635394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bda85bf1-10fc-4ba9-a9b0-2af1e219bd77 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.223473 Jun 29 08:47:21.636102 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9448afc8-4e73-4c96-bc39-6e2288621d9a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:21.636227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 554/1060] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:21 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:21.642851 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9448afc8-4e73-4c96-bc39-6e2288621d9a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.643267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9448afc8-4e73-4c96-bc39-6e2288621d9a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.644031 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9448afc8-4e73-4c96-bc39-6e2288621d9a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.644479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9448afc8-4e73-4c96-bc39-6e2288621d9a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.646860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-194da0a6-ecb2-4406-8741-4b879de4928f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:21.653329 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-194da0a6-ecb2-4406-8741-4b879de4928f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.653858 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-194da0a6-ecb2-4406-8741-4b879de4928f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.676284 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-194da0a6-ecb2-4406-8741-4b879de4928f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Going to try to start instance {{(pid=124266) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 08:47:21.705652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9448afc8-4e73-4c96-bc39-6e2288621d9a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:21.713487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9448afc8-4e73-4c96-bc39-6e2288621d9a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1137 microversion: 2.1 time: 0.081850 Jun 29 08:47:21.714132 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 507/1061] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:21 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:21.722208 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-194da0a6-ecb2-4406-8741-4b879de4928f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/action" status: 202 len: 0 microversion: 2.1 time: 0.079125 Jun 29 08:47:21.722825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 555/1062] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:47:21 2022] POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:47:21.731718 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-50313547-1d9e-4a2f-89da-b80bff492d6c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:21.732327 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-50313547-1d9e-4a2f-89da-b80bff492d6c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:21.738642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50313547-1d9e-4a2f-89da-b80bff492d6c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.739171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50313547-1d9e-4a2f-89da-b80bff492d6c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.739960 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50313547-1d9e-4a2f-89da-b80bff492d6c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:21.740423 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-50313547-1d9e-4a2f-89da-b80bff492d6c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:21.891777 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-50313547-1d9e-4a2f-89da-b80bff492d6c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:21.899873 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-50313547-1d9e-4a2f-89da-b80bff492d6c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1708 microversion: 2.1 time: 0.172732 Jun 29 08:47:21.900441 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 508/1063] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:21 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1708 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:47:22.659763 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:22.660898 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:22.670655 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:22.671127 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:22.671879 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:22.672305 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:22.733323 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a58120d6-82fa-462c-baa3-9c5b691ee449 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:22.733904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a58120d6-82fa-462c-baa3-9c5b691ee449 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:22.740551 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a58120d6-82fa-462c-baa3-9c5b691ee449 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:22.741130 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a58120d6-82fa-462c-baa3-9c5b691ee449 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:22.741953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a58120d6-82fa-462c-baa3-9c5b691ee449 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:22.742376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a58120d6-82fa-462c-baa3-9c5b691ee449 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:22.806667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a58120d6-82fa-462c-baa3-9c5b691ee449 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:22.814607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a58120d6-82fa-462c-baa3-9c5b691ee449 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1137 microversion: 2.1 time: 0.085608 Jun 29 08:47:22.815215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 509/1064] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:22 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:22.829492 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:22.842643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:22.844892 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:22.846763 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a49a85b4-cc32-40e2-9503-6adccad6c9ab tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.194880 Jun 29 08:47:22.847547 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 556/1065] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:22 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:22.920022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5d638958-e450-4c07-beb6-b88f5acf5dfa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:22.920822 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5d638958-e450-4c07-beb6-b88f5acf5dfa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:22.930041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5d638958-e450-4c07-beb6-b88f5acf5dfa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:22.930620 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5d638958-e450-4c07-beb6-b88f5acf5dfa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:22.931778 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5d638958-e450-4c07-beb6-b88f5acf5dfa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:22.932326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5d638958-e450-4c07-beb6-b88f5acf5dfa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:23.073911 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5d638958-e450-4c07-beb6-b88f5acf5dfa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:23.086531 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5d638958-e450-4c07-beb6-b88f5acf5dfa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1708 microversion: 2.1 time: 0.172689 Jun 29 08:47:23.087332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 510/1066] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:22 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1708 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:23.831988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-81c0b52b-ad06-4de7-8905-ddc07e4e07b3 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:23.832555 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-81c0b52b-ad06-4de7-8905-ddc07e4e07b3 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:23.839355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81c0b52b-ad06-4de7-8905-ddc07e4e07b3 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:23.840144 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81c0b52b-ad06-4de7-8905-ddc07e4e07b3 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:23.841175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81c0b52b-ad06-4de7-8905-ddc07e4e07b3 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:23.841529 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81c0b52b-ad06-4de7-8905-ddc07e4e07b3 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:23.865005 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:23.865615 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:23.873684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:23.874107 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:23.874916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:23.875354 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:23.909387 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-81c0b52b-ad06-4de7-8905-ddc07e4e07b3 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:23.917519 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-81c0b52b-ad06-4de7-8905-ddc07e4e07b3 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1137 microversion: 2.1 time: 0.089638 Jun 29 08:47:23.918100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 557/1067] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:23 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:24.016663 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:24.020226 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=100 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:24.025185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:24.026670 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:24.027886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5f70d4e3-6578-4a97-9703-ad086ba19785 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.166906 Jun 29 08:47:24.028446 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 511/1068] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:23 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:24.110564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9d7ba534-c42e-452e-a82a-ca381e7d0bdf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:24.111625 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9d7ba534-c42e-452e-a82a-ca381e7d0bdf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:24.122806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d7ba534-c42e-452e-a82a-ca381e7d0bdf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:24.123592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d7ba534-c42e-452e-a82a-ca381e7d0bdf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:24.124847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d7ba534-c42e-452e-a82a-ca381e7d0bdf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:24.125559 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d7ba534-c42e-452e-a82a-ca381e7d0bdf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:24.279742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9d7ba534-c42e-452e-a82a-ca381e7d0bdf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:24.288024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9d7ba534-c42e-452e-a82a-ca381e7d0bdf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1708 microversion: 2.1 time: 0.184436 Jun 29 08:47:24.288599 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 558/1069] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:24 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1708 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:24.936336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b0a5e088-a27e-4008-b9e0-a410d9ab8882 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:24.936870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b0a5e088-a27e-4008-b9e0-a410d9ab8882 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:24.943713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b0a5e088-a27e-4008-b9e0-a410d9ab8882 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:24.944156 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b0a5e088-a27e-4008-b9e0-a410d9ab8882 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:24.944928 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b0a5e088-a27e-4008-b9e0-a410d9ab8882 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:24.945344 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b0a5e088-a27e-4008-b9e0-a410d9ab8882 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:25.026567 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b0a5e088-a27e-4008-b9e0-a410d9ab8882 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:25.037478 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b0a5e088-a27e-4008-b9e0-a410d9ab8882 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1201 microversion: 2.1 time: 0.105974 Jun 29 08:47:25.038289 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 512/1070] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:24 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:47:25.054237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:25.055461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:25.062243 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:25.062957 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:25.063887 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:25.064460 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:25.290246 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:25.298871 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:25.300998 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:25.302391 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a17caac1-dd3b-4a61-bca5-2fe4327a88d4 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.251949 Jun 29 08:47:25.303311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 559/1071] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:25 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:25.306242 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bd358df3-de51-4c49-9720-bd1fb000e6ee tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:25.306888 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bd358df3-de51-4c49-9720-bd1fb000e6ee tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:25.313779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bd358df3-de51-4c49-9720-bd1fb000e6ee tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:25.314821 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bd358df3-de51-4c49-9720-bd1fb000e6ee tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:25.315029 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bd358df3-de51-4c49-9720-bd1fb000e6ee tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:25.315464 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bd358df3-de51-4c49-9720-bd1fb000e6ee tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:25.447806 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-bd358df3-de51-4c49-9720-bd1fb000e6ee tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:25.456913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bd358df3-de51-4c49-9720-bd1fb000e6ee tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1708 microversion: 2.1 time: 0.155190 Jun 29 08:47:25.463189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 513/1072] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:25 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:26.057956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4ada425c-c4b5-4a4c-8cae-3c8c5c0d7ca9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:26.059302 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4ada425c-c4b5-4a4c-8cae-3c8c5c0d7ca9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:26.067165 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4ada425c-c4b5-4a4c-8cae-3c8c5c0d7ca9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:26.067703 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4ada425c-c4b5-4a4c-8cae-3c8c5c0d7ca9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:26.068587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4ada425c-c4b5-4a4c-8cae-3c8c5c0d7ca9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:26.069111 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4ada425c-c4b5-4a4c-8cae-3c8c5c0d7ca9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:26.135545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4ada425c-c4b5-4a4c-8cae-3c8c5c0d7ca9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:26.143572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4ada425c-c4b5-4a4c-8cae-3c8c5c0d7ca9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1199 microversion: 2.1 time: 0.090281 Jun 29 08:47:26.144129 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 560/1073] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:26 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1199 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:47:26.320497 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:26.321059 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:26.328103 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:26.328523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:26.329292 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:26.329682 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:26.470989 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:26.479323 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c5b175e9-b947-4f91-be31-8b70786940ab tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:26.480862 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c5b175e9-b947-4f91-be31-8b70786940ab tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:26.486810 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:26.488575 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:26.489256 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c5b175e9-b947-4f91-be31-8b70786940ab tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:26.489937 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c5b175e9-b947-4f91-be31-8b70786940ab tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:26.490294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-46fe43aa-5dc9-4fa6-bc43-21153b9ac5da tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.173658 Jun 29 08:47:26.491060 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c5b175e9-b947-4f91-be31-8b70786940ab tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:26.491205 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 514/1074] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:26 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:26.491796 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c5b175e9-b947-4f91-be31-8b70786940ab tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:26.626716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c5b175e9-b947-4f91-be31-8b70786940ab tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:26.634895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c5b175e9-b947-4f91-be31-8b70786940ab tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1708 microversion: 2.1 time: 0.163454 Jun 29 08:47:26.635667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 561/1075] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:26 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:47:27.061603 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-d3bcfba1-5052-4e62-b85d-8dc8ec4f6ed2 req-e928d961-0354-486e-b429-c9a32ad054ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3dd3baa-8bfc-43a2-801d-83e48e7d2291", "tag": "522e353e-263c-429f-b35c-cc2866fded03"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:27.070652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-d3bcfba1-5052-4e62-b85d-8dc8ec4f6ed2 req-e928d961-0354-486e-b429-c9a32ad054ac service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:27.071535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-d3bcfba1-5052-4e62-b85d-8dc8ec4f6ed2 req-e928d961-0354-486e-b429-c9a32ad054ac service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:27.083281 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-d3bcfba1-5052-4e62-b85d-8dc8ec4f6ed2 req-e928d961-0354-486e-b429-c9a32ad054ac service nova] Creating event network-changed:522e353e-263c-429f-b35c-cc2866fded03 for instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 on hv-cinder-79760 Jun 29 08:47:27.088131 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-d3bcfba1-5052-4e62-b85d-8dc8ec4f6ed2 req-e928d961-0354-486e-b429-c9a32ad054ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030344 Jun 29 08:47:27.088660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 515/1076] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:47:27.163187 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1bea1f48-88e3-405e-b569-4f04d50b2587 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:27.164071 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1bea1f48-88e3-405e-b569-4f04d50b2587 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:27.171326 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1bea1f48-88e3-405e-b569-4f04d50b2587 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:27.171760 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1bea1f48-88e3-405e-b569-4f04d50b2587 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:27.172529 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1bea1f48-88e3-405e-b569-4f04d50b2587 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:27.172987 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1bea1f48-88e3-405e-b569-4f04d50b2587 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:27.311701 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1bea1f48-88e3-405e-b569-4f04d50b2587 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:27.319605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1bea1f48-88e3-405e-b569-4f04d50b2587 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.162433 Jun 29 08:47:27.320179 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 562/1077] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:27 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:27.516279 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:27.517456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:27.528432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:27.528869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:27.529634 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:27.530062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:27.652335 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec3de5de-5c9a-4cd2-80b2-ef0fa0ca4599 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:27.652965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec3de5de-5c9a-4cd2-80b2-ef0fa0ca4599 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:27.659553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec3de5de-5c9a-4cd2-80b2-ef0fa0ca4599 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:27.660062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec3de5de-5c9a-4cd2-80b2-ef0fa0ca4599 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:27.660821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec3de5de-5c9a-4cd2-80b2-ef0fa0ca4599 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:27.661246 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec3de5de-5c9a-4cd2-80b2-ef0fa0ca4599 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:27.671603 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:27.681002 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:27.682796 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:27.684789 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-df25645d-1abf-479f-9b3d-2cfba4fb817d tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.177047 Jun 29 08:47:27.685839 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 516/1078] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:27 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:27.802192 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec3de5de-5c9a-4cd2-80b2-ef0fa0ca4599 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:27.813100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec3de5de-5c9a-4cd2-80b2-ef0fa0ca4599 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1708 microversion: 2.1 time: 0.164459 Jun 29 08:47:27.814723 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 563/1079] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:27 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:27.839054 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-9e63d547-23fa-4231-bd9d-5ceb4f87c938 req-de5d0d54-5aae-4434-b82e-f9460caa8614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f64cb6c-8320-480e-b79c-bb55a51513b8", "name": "network-vif-plugged", "status": "completed", "tag": "0a7a70f1-09de-40ce-b9fe-437390cf5dab"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:27.849316 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-9e63d547-23fa-4231-bd9d-5ceb4f87c938 req-de5d0d54-5aae-4434-b82e-f9460caa8614 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:27.849973 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-9e63d547-23fa-4231-bd9d-5ceb4f87c938 req-de5d0d54-5aae-4434-b82e-f9460caa8614 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:27.862396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-9e63d547-23fa-4231-bd9d-5ceb4f87c938 req-de5d0d54-5aae-4434-b82e-f9460caa8614 service nova] Creating event network-vif-plugged:0a7a70f1-09de-40ce-b9fe-437390cf5dab for instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 on hv-cinder-79760 Jun 29 08:47:27.868440 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-9e63d547-23fa-4231-bd9d-5ceb4f87c938 req-de5d0d54-5aae-4434-b82e-f9460caa8614 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034183 Jun 29 08:47:27.869660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 517/1080] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:47:28.342085 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ae623ef2-0de7-4dbe-91f9-2299d203d301 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:28.342800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ae623ef2-0de7-4dbe-91f9-2299d203d301 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:28.349995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae623ef2-0de7-4dbe-91f9-2299d203d301 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:28.350442 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae623ef2-0de7-4dbe-91f9-2299d203d301 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:28.351240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae623ef2-0de7-4dbe-91f9-2299d203d301 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:28.351672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae623ef2-0de7-4dbe-91f9-2299d203d301 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:28.490096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ae623ef2-0de7-4dbe-91f9-2299d203d301 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:28.501987 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ae623ef2-0de7-4dbe-91f9-2299d203d301 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.166293 Jun 29 08:47:28.502938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 564/1081] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:28 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:28.705807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:28.706494 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:28.713332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:28.713770 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:28.714521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:28.715331 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:28.830321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8d6cec33-07d7-4a70-8670-b521bd95a6aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:28.830940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8d6cec33-07d7-4a70-8670-b521bd95a6aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:28.837411 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d6cec33-07d7-4a70-8670-b521bd95a6aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:28.837864 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d6cec33-07d7-4a70-8670-b521bd95a6aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:28.839035 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d6cec33-07d7-4a70-8670-b521bd95a6aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:28.839152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d6cec33-07d7-4a70-8670-b521bd95a6aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:28.856819 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:28.865257 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:28.866776 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:28.867983 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-48b8f393-c58a-40d3-997c-ddaeb530036c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.167060 Jun 29 08:47:28.870737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 518/1082] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:28 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:28.977096 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8d6cec33-07d7-4a70-8670-b521bd95a6aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:28.979474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:28.987378 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8d6cec33-07d7-4a70-8670-b521bd95a6aa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1712 microversion: 2.1 time: 0.161003 Jun 29 08:47:28.987977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 565/1083] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:28 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1712 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:29.521908 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d7e715b6-3dc1-4c57-bb8f-bccd927a6c65 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:29.522544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d7e715b6-3dc1-4c57-bb8f-bccd927a6c65 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:29.529015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d7e715b6-3dc1-4c57-bb8f-bccd927a6c65 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:29.529485 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d7e715b6-3dc1-4c57-bb8f-bccd927a6c65 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:29.530444 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d7e715b6-3dc1-4c57-bb8f-bccd927a6c65 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:29.531124 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d7e715b6-3dc1-4c57-bb8f-bccd927a6c65 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:29.664008 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d7e715b6-3dc1-4c57-bb8f-bccd927a6c65 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:29.672104 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d7e715b6-3dc1-4c57-bb8f-bccd927a6c65 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.155529 Jun 29 08:47:29.681544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 519/1084] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:29 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:29.887591 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:29.888372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:29.896034 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:29.896474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:29.897228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:29.897657 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:30.031473 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:30.042444 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:30.044230 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:30.045473 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4a2ff08b-4946-473f-bdf6-51b18fdf5070 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.162961 Jun 29 08:47:30.046026 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 566/1085] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:29 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:30.690723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0bc8058f-1ca6-4a8a-b396-47263efb0bae tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:30.691357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0bc8058f-1ca6-4a8a-b396-47263efb0bae tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:30.698546 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0bc8058f-1ca6-4a8a-b396-47263efb0bae tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:30.699016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0bc8058f-1ca6-4a8a-b396-47263efb0bae tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:30.699774 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0bc8058f-1ca6-4a8a-b396-47263efb0bae tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:30.700178 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0bc8058f-1ca6-4a8a-b396-47263efb0bae tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:30.841021 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0bc8058f-1ca6-4a8a-b396-47263efb0bae tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:30.852735 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0bc8058f-1ca6-4a8a-b396-47263efb0bae tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.166079 Jun 29 08:47:30.853555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 520/1086] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:30 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:31.068313 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:31.069178 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:31.078726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:31.079202 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:31.079956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:31.080380 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:31.225785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:31.237550 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:31.239948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:31.241625 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2fbcfdf6-b13e-41c8-aff1-3e56a8054bd8 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1731 microversion: 2.20 time: 0.179909 Jun 29 08:47:31.242427 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 567/1087] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:31 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:31.873996 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c8692fbe-e21a-449e-b2f6-71022b5ce538 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:31.874556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c8692fbe-e21a-449e-b2f6-71022b5ce538 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:31.881546 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c8692fbe-e21a-449e-b2f6-71022b5ce538 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:31.882057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c8692fbe-e21a-449e-b2f6-71022b5ce538 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:31.882865 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c8692fbe-e21a-449e-b2f6-71022b5ce538 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:31.883301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c8692fbe-e21a-449e-b2f6-71022b5ce538 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:32.026119 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c8692fbe-e21a-449e-b2f6-71022b5ce538 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:32.035125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c8692fbe-e21a-449e-b2f6-71022b5ce538 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.167339 Jun 29 08:47:32.035812 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 521/1088] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:31 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:32.264088 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:32.264683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:32.271804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:32.272243 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:32.272995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:32.273421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:32.404630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:32.413401 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:32.414931 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:32.416089 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-05752086-c093-4e87-9847-60cce93b25ec tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1718 microversion: 2.20 time: 0.158780 Jun 29 08:47:32.416620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 568/1089] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:47:32 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:47:33.057457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2ba08831-a292-4639-8665-941eb9df7847 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:33.058357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2ba08831-a292-4639-8665-941eb9df7847 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:33.069362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2ba08831-a292-4639-8665-941eb9df7847 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:33.070085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2ba08831-a292-4639-8665-941eb9df7847 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:33.071395 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2ba08831-a292-4639-8665-941eb9df7847 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:33.072105 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2ba08831-a292-4639-8665-941eb9df7847 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:33.220922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2ba08831-a292-4639-8665-941eb9df7847 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:33.228783 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2ba08831-a292-4639-8665-941eb9df7847 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.178168 Jun 29 08:47:33.229348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 522/1090] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:33 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:34.249509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-33dfa987-f095-47e6-b53e-a5d79e7d990a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:34.250196 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-33dfa987-f095-47e6-b53e-a5d79e7d990a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:34.252774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:34.259267 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33dfa987-f095-47e6-b53e-a5d79e7d990a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:34.259753 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33dfa987-f095-47e6-b53e-a5d79e7d990a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:34.260592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33dfa987-f095-47e6-b53e-a5d79e7d990a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:34.261065 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-33dfa987-f095-47e6-b53e-a5d79e7d990a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:34.402739 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-33dfa987-f095-47e6-b53e-a5d79e7d990a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:34.411956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-33dfa987-f095-47e6-b53e-a5d79e7d990a tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.168781 Jun 29 08:47:34.412530 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 569/1091] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:34 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:35.432833 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-97c752d0-40b5-487f-9859-8bb070d0b912 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:35.433875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-97c752d0-40b5-487f-9859-8bb070d0b912 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:35.445432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97c752d0-40b5-487f-9859-8bb070d0b912 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:35.446198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97c752d0-40b5-487f-9859-8bb070d0b912 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:35.447686 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97c752d0-40b5-487f-9859-8bb070d0b912 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:35.448393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-97c752d0-40b5-487f-9859-8bb070d0b912 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:35.586128 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-97c752d0-40b5-487f-9859-8bb070d0b912 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:35.596254 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-97c752d0-40b5-487f-9859-8bb070d0b912 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.169933 Jun 29 08:47:35.596813 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 523/1092] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:35 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:36.614969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9e507f00-c6c4-43e1-953c-30911e25adcb tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:36.615644 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9e507f00-c6c4-43e1-953c-30911e25adcb tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:36.623902 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e507f00-c6c4-43e1-953c-30911e25adcb tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:36.624737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e507f00-c6c4-43e1-953c-30911e25adcb tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:36.625634 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e507f00-c6c4-43e1-953c-30911e25adcb tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:36.626137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e507f00-c6c4-43e1-953c-30911e25adcb tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:36.769152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9e507f00-c6c4-43e1-953c-30911e25adcb tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:36.777141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9e507f00-c6c4-43e1-953c-30911e25adcb tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.166936 Jun 29 08:47:36.777709 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 570/1093] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:36 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:37.798288 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2d6c7b39-3ca4-4e7e-b7f8-8f30b9158ee9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:37.799213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2d6c7b39-3ca4-4e7e-b7f8-8f30b9158ee9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:37.803129 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=70 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:47:37.812300 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2d6c7b39-3ca4-4e7e-b7f8-8f30b9158ee9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:37.812733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2d6c7b39-3ca4-4e7e-b7f8-8f30b9158ee9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:37.813489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2d6c7b39-3ca4-4e7e-b7f8-8f30b9158ee9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:37.813909 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2d6c7b39-3ca4-4e7e-b7f8-8f30b9158ee9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:37.957213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2d6c7b39-3ca4-4e7e-b7f8-8f30b9158ee9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:37.969797 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2d6c7b39-3ca4-4e7e-b7f8-8f30b9158ee9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.177833 Jun 29 08:47:37.970600 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 524/1094] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:37 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:38.996929 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1ebaee09-0a8c-4d72-aa37-c165ae4d63bc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:38.997861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1ebaee09-0a8c-4d72-aa37-c165ae4d63bc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:39.004964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebaee09-0a8c-4d72-aa37-c165ae4d63bc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:39.005442 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebaee09-0a8c-4d72-aa37-c165ae4d63bc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:39.006199 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebaee09-0a8c-4d72-aa37-c165ae4d63bc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:39.006632 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ebaee09-0a8c-4d72-aa37-c165ae4d63bc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:39.151340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1ebaee09-0a8c-4d72-aa37-c165ae4d63bc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:39.162309 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1ebaee09-0a8c-4d72-aa37-c165ae4d63bc tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.171673 Jun 29 08:47:39.163456 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 571/1095] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:38 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:40.202325 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9f939502-7f1e-4062-9e1b-59c3c3c1a139 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:40.203284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9f939502-7f1e-4062-9e1b-59c3c3c1a139 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:40.211177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9f939502-7f1e-4062-9e1b-59c3c3c1a139 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:40.211675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9f939502-7f1e-4062-9e1b-59c3c3c1a139 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:40.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9f939502-7f1e-4062-9e1b-59c3c3c1a139 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:40.212988 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9f939502-7f1e-4062-9e1b-59c3c3c1a139 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:40.364684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9f939502-7f1e-4062-9e1b-59c3c3c1a139 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:40.372663 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9f939502-7f1e-4062-9e1b-59c3c3c1a139 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.176901 Jun 29 08:47:40.373237 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 525/1096] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:40 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:41.392334 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1d86aaa1-4453-42c6-bba9-4d1b80a178b8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:41.393029 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1d86aaa1-4453-42c6-bba9-4d1b80a178b8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:41.403621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d86aaa1-4453-42c6-bba9-4d1b80a178b8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:41.404280 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d86aaa1-4453-42c6-bba9-4d1b80a178b8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:41.405264 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d86aaa1-4453-42c6-bba9-4d1b80a178b8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:41.405830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d86aaa1-4453-42c6-bba9-4d1b80a178b8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:41.542343 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d86aaa1-4453-42c6-bba9-4d1b80a178b8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:41.551024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1d86aaa1-4453-42c6-bba9-4d1b80a178b8 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.164812 Jun 29 08:47:41.551588 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 572/1097] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:41 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:42.157660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-71cd74d7-9a72-4cf2-a7ac-3ce05720cea7 req-d2e1f931-af8e-4273-b0a5-fbeee3e39fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dd3baa-8bfc-43a2-801d-83e48e7d2291", "name": "network-vif-plugged", "status": "completed", "tag": "522e353e-263c-429f-b35c-cc2866fded03"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:42.166174 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-71cd74d7-9a72-4cf2-a7ac-3ce05720cea7 req-d2e1f931-af8e-4273-b0a5-fbeee3e39fe8 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:42.166607 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-71cd74d7-9a72-4cf2-a7ac-3ce05720cea7 req-d2e1f931-af8e-4273-b0a5-fbeee3e39fe8 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:42.178105 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-71cd74d7-9a72-4cf2-a7ac-3ce05720cea7 req-d2e1f931-af8e-4273-b0a5-fbeee3e39fe8 service nova] Creating event network-vif-plugged:522e353e-263c-429f-b35c-cc2866fded03 for instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 on hv-cinder-79760 Jun 29 08:47:42.183100 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-71cd74d7-9a72-4cf2-a7ac-3ce05720cea7 req-d2e1f931-af8e-4273-b0a5-fbeee3e39fe8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029316 Jun 29 08:47:42.183692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 526/1098] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:47:42.568196 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6afcfda2-2d11-4edf-869c-3f22806476e1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:42.568806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6afcfda2-2d11-4edf-869c-3f22806476e1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:42.575850 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6afcfda2-2d11-4edf-869c-3f22806476e1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:42.576285 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6afcfda2-2d11-4edf-869c-3f22806476e1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:42.577040 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6afcfda2-2d11-4edf-869c-3f22806476e1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:42.577467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6afcfda2-2d11-4edf-869c-3f22806476e1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:42.719476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6afcfda2-2d11-4edf-869c-3f22806476e1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:42.727421 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6afcfda2-2d11-4edf-869c-3f22806476e1 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.163234 Jun 29 08:47:42.727989 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 573/1099] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:42 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:43.750831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0572354c-ffb8-4042-af49-ef60624f5588 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:43.751623 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0572354c-ffb8-4042-af49-ef60624f5588 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:43.759336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0572354c-ffb8-4042-af49-ef60624f5588 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:43.759892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0572354c-ffb8-4042-af49-ef60624f5588 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:43.760806 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0572354c-ffb8-4042-af49-ef60624f5588 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:43.761311 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0572354c-ffb8-4042-af49-ef60624f5588 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:43.898980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0572354c-ffb8-4042-af49-ef60624f5588 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:43.909804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0572354c-ffb8-4042-af49-ef60624f5588 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.167354 Jun 29 08:47:43.910713 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 527/1100] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:43 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:44.934861 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4d09d733-b04a-4c44-8c7d-fead4d6ce7a5 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:44.935919 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4d09d733-b04a-4c44-8c7d-fead4d6ce7a5 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:44.943553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d09d733-b04a-4c44-8c7d-fead4d6ce7a5 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:44.943999 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d09d733-b04a-4c44-8c7d-fead4d6ce7a5 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:44.944758 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d09d733-b04a-4c44-8c7d-fead4d6ce7a5 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:44.945185 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d09d733-b04a-4c44-8c7d-fead4d6ce7a5 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:45.086902 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4d09d733-b04a-4c44-8c7d-fead4d6ce7a5 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:45.095014 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4d09d733-b04a-4c44-8c7d-fead4d6ce7a5 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1266 microversion: 2.1 time: 0.166667 Jun 29 08:47:45.095726 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 574/1101] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:44 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:46.120326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f0c13873-6da5-4226-af0e-35e00cd1d304 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:46.121177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f0c13873-6da5-4226-af0e-35e00cd1d304 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:46.132242 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f0c13873-6da5-4226-af0e-35e00cd1d304 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:46.132930 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f0c13873-6da5-4226-af0e-35e00cd1d304 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:46.134118 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f0c13873-6da5-4226-af0e-35e00cd1d304 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:46.134878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f0c13873-6da5-4226-af0e-35e00cd1d304 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:46.269865 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f0c13873-6da5-4226-af0e-35e00cd1d304 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:46.277861 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f0c13873-6da5-4226-af0e-35e00cd1d304 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1452 microversion: 2.1 time: 0.164054 Jun 29 08:47:46.278424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 528/1102] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:46 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:46.297708 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8175c257-c560-4d21-903f-65a02fcec869 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:47:46.298321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8175c257-c560-4d21-903f-65a02fcec869 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:47:46.305310 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8175c257-c560-4d21-903f-65a02fcec869 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:46.305755 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8175c257-c560-4d21-903f-65a02fcec869 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:46.306523 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8175c257-c560-4d21-903f-65a02fcec869 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:46.306984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8175c257-c560-4d21-903f-65a02fcec869 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:46.449796 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8175c257-c560-4d21-903f-65a02fcec869 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:47:46.457756 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8175c257-c560-4d21-903f-65a02fcec869 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1452 microversion: 2.1 time: 0.166180 Jun 29 08:47:46.458363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 575/1103] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:47:46 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:47:48.286429 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-cfb434a1-b677-4d17-93ad-3c963617b7ba req-1baaa578-964f-491d-a79d-2026223e3be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3dd3baa-8bfc-43a2-801d-83e48e7d2291", "tag": "522e353e-263c-429f-b35c-cc2866fded03"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:47:48.294962 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-cfb434a1-b677-4d17-93ad-3c963617b7ba req-1baaa578-964f-491d-a79d-2026223e3be7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:47:48.295392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-cfb434a1-b677-4d17-93ad-3c963617b7ba req-1baaa578-964f-491d-a79d-2026223e3be7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:47:48.306771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-cfb434a1-b677-4d17-93ad-3c963617b7ba req-1baaa578-964f-491d-a79d-2026223e3be7 service nova] Creating event network-changed:522e353e-263c-429f-b35c-cc2866fded03 for instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 on hv-cinder-79760 Jun 29 08:47:48.312140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-cfb434a1-b677-4d17-93ad-3c963617b7ba req-1baaa578-964f-491d-a79d-2026223e3be7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029425 Jun 29 08:47:48.313063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 529/1104] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:36.698972 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:48:36.699960 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Wed Jun 29 08:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:48:36.936629 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-05dc25c8-bead-4069-ab31-e8a0e4be7dc4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:36.937440 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-05dc25c8-bead-4069-ab31-e8a0e4be7dc4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:36.940708 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=13 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:48:36.941770 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=61 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:48:36.951130 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-05dc25c8-bead-4069-ab31-e8a0e4be7dc4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:36.951505 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-05dc25c8-bead-4069-ab31-e8a0e4be7dc4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:36.952271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-05dc25c8-bead-4069-ab31-e8a0e4be7dc4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:36.952696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-05dc25c8-bead-4069-ab31-e8a0e4be7dc4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:36.976638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-05dc25c8-bead-4069-ab31-e8a0e4be7dc4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/ips" status: 200 len: 150 microversion: 2.1 time: 0.046921 Jun 29 08:48:36.977192 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 576/1105] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:48:36 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:39.392108 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=11 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:48:39.392868 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=92 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:48:39.398057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-26b7150e-5851-4a08-9bad-13fd828c7387 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd4a8250-d2e7-47f0-ad0b-47462a8a9128"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:48:39.399259 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-26b7150e-5851-4a08-9bad-13fd828c7387 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:39.406270 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-26b7150e-5851-4a08-9bad-13fd828c7387 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:39.406720 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-26b7150e-5851-4a08-9bad-13fd828c7387 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:39.407484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-26b7150e-5851-4a08-9bad-13fd828c7387 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:39.408007 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-26b7150e-5851-4a08-9bad-13fd828c7387 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:39.712860 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-26b7150e-5851-4a08-9bad-13fd828c7387 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "POST /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322391 Jun 29 08:48:39.715305 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 530/1106] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:48:39 2022] POST /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:45.384300 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1bd5be0b-ee2a-4f4d-b567-af59b38fc800 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:45.384831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1bd5be0b-ee2a-4f4d-b567-af59b38fc800 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:45.387950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-14a75331-c3db-4163-9138-aeef70a26a22 req-2271d7cb-8332-42c0-aeae-3865147abad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbea51b8-1348-4834-badb-56258435cd06", "tag": "d7fdedc4-9082-4237-a3a6-f3fe54501c3f"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:48:45.390962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1bd5be0b-ee2a-4f4d-b567-af59b38fc800 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:45.391397 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1bd5be0b-ee2a-4f4d-b567-af59b38fc800 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:45.392378 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1bd5be0b-ee2a-4f4d-b567-af59b38fc800 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:45.392806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1bd5be0b-ee2a-4f4d-b567-af59b38fc800 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:45.397311 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-14a75331-c3db-4163-9138-aeef70a26a22 req-2271d7cb-8332-42c0-aeae-3865147abad5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:45.397744 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-14a75331-c3db-4163-9138-aeef70a26a22 req-2271d7cb-8332-42c0-aeae-3865147abad5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:45.410028 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-14a75331-c3db-4163-9138-aeef70a26a22 req-2271d7cb-8332-42c0-aeae-3865147abad5 service nova] Creating event network-changed:d7fdedc4-9082-4237-a3a6-f3fe54501c3f for instance cbea51b8-1348-4834-badb-56258435cd06 on hv-cinder-79760 Jun 29 08:48:45.415286 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-14a75331-c3db-4163-9138-aeef70a26a22 req-2271d7cb-8332-42c0-aeae-3865147abad5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031963 Jun 29 08:48:45.416171 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 531/1107] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:45.423463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1bd5be0b-ee2a-4f4d-b567-af59b38fc800 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:48:45.523542 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1bd5be0b-ee2a-4f4d-b567-af59b38fc800 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 204 len: 0 microversion: 2.1 time: 0.142908 Jun 29 08:48:45.524100 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 577/1108] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:48:45 2022] DELETE /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:48:45.533846 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b592f0c4-ec27-4cb9-ba4b-600c22c60e96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:45.535287 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b592f0c4-ec27-4cb9-ba4b-600c22c60e96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:45.541918 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b592f0c4-ec27-4cb9-ba4b-600c22c60e96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:45.542368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b592f0c4-ec27-4cb9-ba4b-600c22c60e96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:45.543181 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b592f0c4-ec27-4cb9-ba4b-600c22c60e96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:45.543611 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b592f0c4-ec27-4cb9-ba4b-600c22c60e96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:45.678552 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b592f0c4-ec27-4cb9-ba4b-600c22c60e96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:45.686297 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b592f0c4-ec27-4cb9-ba4b-600c22c60e96 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.156946 Jun 29 08:48:45.686880 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 532/1109] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:45 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:46.710247 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cedbeb14-8015-4184-9372-f31871821f42 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:46.711300 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cedbeb14-8015-4184-9372-f31871821f42 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:46.722340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cedbeb14-8015-4184-9372-f31871821f42 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:46.722821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cedbeb14-8015-4184-9372-f31871821f42 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:46.723589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cedbeb14-8015-4184-9372-f31871821f42 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:46.724020 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cedbeb14-8015-4184-9372-f31871821f42 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:46.867073 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cedbeb14-8015-4184-9372-f31871821f42 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:46.874772 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cedbeb14-8015-4184-9372-f31871821f42 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.172059 Jun 29 08:48:46.875344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 578/1110] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:46 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:47.892362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-98e99aa8-44ee-4e8c-af9d-8cc3649096c1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:47.892946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-98e99aa8-44ee-4e8c-af9d-8cc3649096c1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:47.899985 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-98e99aa8-44ee-4e8c-af9d-8cc3649096c1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:47.900433 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-98e99aa8-44ee-4e8c-af9d-8cc3649096c1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:47.901199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-98e99aa8-44ee-4e8c-af9d-8cc3649096c1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:47.901628 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-98e99aa8-44ee-4e8c-af9d-8cc3649096c1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:48.042597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-98e99aa8-44ee-4e8c-af9d-8cc3649096c1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:48.050904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-98e99aa8-44ee-4e8c-af9d-8cc3649096c1 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1566 microversion: 2.1 time: 0.162442 Jun 29 08:48:48.051475 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 533/1111] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:47 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:49.007012 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-e6e44033-a9b2-4535-a565-4e4c8ad82cd8 req-2e7e7fdd-d751-4bad-b8f8-90a2b61c6801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbea51b8-1348-4834-badb-56258435cd06", "name": "network-vif-deleted", "tag": "d7fdedc4-9082-4237-a3a6-f3fe54501c3f"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:48:49.016034 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e6e44033-a9b2-4535-a565-4e4c8ad82cd8 req-2e7e7fdd-d751-4bad-b8f8-90a2b61c6801 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.016463 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e6e44033-a9b2-4535-a565-4e4c8ad82cd8 req-2e7e7fdd-d751-4bad-b8f8-90a2b61c6801 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.027887 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-e6e44033-a9b2-4535-a565-4e4c8ad82cd8 req-2e7e7fdd-d751-4bad-b8f8-90a2b61c6801 service nova] Creating event network-vif-deleted:d7fdedc4-9082-4237-a3a6-f3fe54501c3f for instance cbea51b8-1348-4834-badb-56258435cd06 on hv-cinder-79760 Jun 29 08:48:49.032614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-e6e44033-a9b2-4535-a565-4e4c8ad82cd8 req-2e7e7fdd-d751-4bad-b8f8-90a2b61c6801 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029397 Jun 29 08:48:49.033217 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 579/1112] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:49.071387 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-eeed2d37-817d-441d-8dfc-f48deb9a69cc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:49.072039 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-eeed2d37-817d-441d-8dfc-f48deb9a69cc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:49.079798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eeed2d37-817d-441d-8dfc-f48deb9a69cc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.080244 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eeed2d37-817d-441d-8dfc-f48deb9a69cc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.081394 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eeed2d37-817d-441d-8dfc-f48deb9a69cc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.081808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-eeed2d37-817d-441d-8dfc-f48deb9a69cc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.147895 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-eeed2d37-817d-441d-8dfc-f48deb9a69cc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:49.156519 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-eeed2d37-817d-441d-8dfc-f48deb9a69cc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1219 microversion: 2.1 time: 0.090670 Jun 29 08:48:49.157083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 534/1113] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:49 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:49.173058 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4dc069fd-437d-4ce5-8135-1499d7ea8ff2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:49.174074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4dc069fd-437d-4ce5-8135-1499d7ea8ff2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:49.180458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4dc069fd-437d-4ce5-8135-1499d7ea8ff2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.180901 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4dc069fd-437d-4ce5-8135-1499d7ea8ff2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.181653 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4dc069fd-437d-4ce5-8135-1499d7ea8ff2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.182077 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4dc069fd-437d-4ce5-8135-1499d7ea8ff2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.209705 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4dc069fd-437d-4ce5-8135-1499d7ea8ff2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041178 Jun 29 08:48:49.210219 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 580/1114] 10.222.0.27 () {60 vars in 1342 bytes} [Wed Jun 29 08:48:49 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:49.270225 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9516cf99-582a-45b0-8218-8461d21756ff tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:49.270954 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9516cf99-582a-45b0-8218-8461d21756ff tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:49.277651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9516cf99-582a-45b0-8218-8461d21756ff tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.278275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9516cf99-582a-45b0-8218-8461d21756ff tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.279079 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9516cf99-582a-45b0-8218-8461d21756ff tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.279633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9516cf99-582a-45b0-8218-8461d21756ff tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.310129 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9516cf99-582a-45b0-8218-8461d21756ff tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:48:49.418087 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9516cf99-582a-45b0-8218-8461d21756ff tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 204 len: 0 microversion: 2.20 time: 0.151236 Jun 29 08:48:49.419009 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 535/1115] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Jun 29 08:48:49 2022] DELETE /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 08:48:49.428239 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:49.428857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:49.435489 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.435941 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.436721 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.437151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.495473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-336e4b96-88c7-437f-bd7e-c82ccab90282 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:49.496071 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-336e4b96-88c7-437f-bd7e-c82ccab90282 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:49.502321 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-336e4b96-88c7-437f-bd7e-c82ccab90282 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.502855 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-336e4b96-88c7-437f-bd7e-c82ccab90282 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.503861 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-336e4b96-88c7-437f-bd7e-c82ccab90282 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.504361 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-336e4b96-88c7-437f-bd7e-c82ccab90282 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.577489 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:49.585890 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:49.587433 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:49.588604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a72c0b5d-e4a3-4278-8ecd-92b48db48104 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.165267 Jun 29 08:48:49.588923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-336e4b96-88c7-437f-bd7e-c82ccab90282 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lazy-loading 'services' on Instance uuid dd356b2c-5d79-440e-9710-0e7808621c28 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:48:49.589529 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 581/1116] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:48:49 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:48:49.676963 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-336e4b96-88c7-437f-bd7e-c82ccab90282 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments/bd4a8250-d2e7-47f0-ad0b-47462a8a9128" status: 202 len: 0 microversion: 2.1 time: 0.185592 Jun 29 08:48:49.677577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 536/1117] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:48:49 2022] DELETE /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments/bd4a8250-d2e7-47f0-ad0b-47462a8a9128 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:48:49.686447 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-30f50416-0d53-439b-8c07-9690d7212e46 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:49.687453 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-30f50416-0d53-439b-8c07-9690d7212e46 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:49.693851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30f50416-0d53-439b-8c07-9690d7212e46 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.694304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30f50416-0d53-439b-8c07-9690d7212e46 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.695090 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30f50416-0d53-439b-8c07-9690d7212e46 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:49.695522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30f50416-0d53-439b-8c07-9690d7212e46 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:49.726355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-30f50416-0d53-439b-8c07-9690d7212e46 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Jun 29 08:48:49.726948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 582/1118] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:48:49 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:50.177223 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e410567f-4fd0-4601-9943-fec51b527311 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:50.177878 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e410567f-4fd0-4601-9943-fec51b527311 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:50.184619 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e410567f-4fd0-4601-9943-fec51b527311 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:50.185056 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e410567f-4fd0-4601-9943-fec51b527311 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:50.185801 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e410567f-4fd0-4601-9943-fec51b527311 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:50.186222 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e410567f-4fd0-4601-9943-fec51b527311 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:50.259109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e410567f-4fd0-4601-9943-fec51b527311 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:50.267076 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e410567f-4fd0-4601-9943-fec51b527311 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1219 microversion: 2.1 time: 0.096617 Jun 29 08:48:50.267687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 537/1119] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:50 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:50.609254 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:50.610069 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:50.617383 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:50.617984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:50.618921 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:50.619349 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:50.737775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a99f4207-0452-4865-b4a7-d5225b06a501 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:50.738645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a99f4207-0452-4865-b4a7-d5225b06a501 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:50.744646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a99f4207-0452-4865-b4a7-d5225b06a501 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:50.745076 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a99f4207-0452-4865-b4a7-d5225b06a501 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:50.746426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a99f4207-0452-4865-b4a7-d5225b06a501 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:50.746900 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a99f4207-0452-4865-b4a7-d5225b06a501 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:50.763204 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:50.782369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:50.783894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:50.784786 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a99f4207-0452-4865-b4a7-d5225b06a501 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050876 Jun 29 08:48:50.789182 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-32594e3c-52fc-4607-9ec7-9ff81c885e3c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.180519 Jun 29 08:48:50.789291 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 538/1120] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:48:50 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:48:50.789399 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 583/1121] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:48:50 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:48:51.285788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:51.286419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:51.293487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:51.294010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:51.294859 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:51.295476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:51.329305 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:51.329744 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:51.330185 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lazy-loading 'fault' on Instance uuid cbea51b8-1348-4834-badb-56258435cd06 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:48:51.382015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c8b04d6294311aeb1124b9139c7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b4ce1d85294063aea6df4b9638c90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:51.389919 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-47f4e3f3-676e-44c9-894f-5e26f946ff59 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 200 len: 1224 microversion: 2.1 time: 0.108972 Jun 29 08:48:51.390503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 539/1122] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:51 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:51.796200 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7dd46d1b-37f1-4290-b262-9a97c864b89e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:51.798834 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7dd46d1b-37f1-4290-b262-9a97c864b89e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:51.803792 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:51.804493 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:51.805894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7dd46d1b-37f1-4290-b262-9a97c864b89e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:51.806797 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7dd46d1b-37f1-4290-b262-9a97c864b89e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:51.807662 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7dd46d1b-37f1-4290-b262-9a97c864b89e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:51.807896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7dd46d1b-37f1-4290-b262-9a97c864b89e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:51.813122 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:51.814165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:51.815231 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:51.817363 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:51.846273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7dd46d1b-37f1-4290-b262-9a97c864b89e tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053964 Jun 29 08:48:51.851137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 584/1123] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:48:51 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:51.951628 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:51.959986 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:51.961469 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:51.962627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-839e77eb-7dd1-4feb-8d54-3c764989cbc9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1724 microversion: 2.20 time: 0.163084 Jun 29 08:48:51.967608 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 540/1124] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:48:51 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:48:52.407397 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:52.408038 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] [instance: cbea51b8-1348-4834-badb-56258435cd06] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:52.415031 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:52.415479 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:52.416283 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:52.416718 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:52.431834 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] HTTP exception thrown: Instance cbea51b8-1348-4834-badb-56258435cd06 could not be found. Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Request method failure captured: Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 HTTP/1.1 Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBB7BLu15W7w0gA2T-nP3OI2EwuPSY3UJ7R9hwNKofmnkalBAKeYjk36z76PjksvtWWS4mfgZKGDyG8ySS31owB2YjVSaGs4yTjynbddK5gNB6UVoQJodUcNqz91tS3icCC7Ugz7hFpfyYIdlBCYCvh47yAsFX4QAIhc5M44covhTFY Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 40b4ce1d85294063aea6df4b9638c90f Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestShelveInstance-212907383 Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:48:52.433518 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40b4ce1d85294063aea6df4b9638c90f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40b4ce1d85294063aea6df4b9638c90f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40b4ce1d85294063aea6df4b9638c90f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40b4ce1d85294063aea6df4b9638c90f"}]}] Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestShelveInstance-212907383 Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 40b4ce1d85294063aea6df4b9638c90f Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestShelveInstance-212907383 Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-TestShelveInstance-212907383-project Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 215c8b04d6294311aeb1124b9139c7fc Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestShelveInstance-212907383-project Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance cbea51b8-1348-4834-badb-56258435cd06 could not be found. Jun 29 08:48:52.435245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'cbea51b8-1348-4834-badb-56258435cd06'} Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbea51b8-1348-4834-badb-56258435cd06 could not be found. Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:48:52.436270 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbea51b8-1348-4834-badb-56258435cd06 could not be found. Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbea51b8-1348-4834-badb-56258435cd06 could not be found. Jun 29 08:48:52.437821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:52.439394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Returning 404 to user: Instance cbea51b8-1348-4834-badb-56258435cd06 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:48:52.439394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a2f474f7-8bcd-4aad-aeab-67905d07b9dc tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06" status: 404 len: 111 microversion: 2.1 time: 0.032096 Jun 29 08:48:52.439394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 585/1125] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:52 2022] GET /compute/v2.1/servers/cbea51b8-1348-4834-badb-56258435cd06 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:48:52.493941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-da078a56-6d86-4aa5-b467-03aaa91524f2 req-231c4322-b2a2-4af4-af72-298ec643ff84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f64cb6c-8320-480e-b79c-bb55a51513b8", "name": "network-vif-deleted", "tag": "0a7a70f1-09de-40ce-b9fe-437390cf5dab"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:48:52.503026 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-da078a56-6d86-4aa5-b467-03aaa91524f2 req-231c4322-b2a2-4af4-af72-298ec643ff84 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:52.503461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-da078a56-6d86-4aa5-b467-03aaa91524f2 req-231c4322-b2a2-4af4-af72-298ec643ff84 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:52.515141 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-da078a56-6d86-4aa5-b467-03aaa91524f2 req-231c4322-b2a2-4af4-af72-298ec643ff84 service nova] Creating event network-vif-deleted:0a7a70f1-09de-40ce-b9fe-437390cf5dab for instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 on hv-cinder-79760 Jun 29 08:48:52.520216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-da078a56-6d86-4aa5-b467-03aaa91524f2 req-231c4322-b2a2-4af4-af72-298ec643ff84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030277 Jun 29 08:48:52.521148 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 541/1126] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:52.623768 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6343a2b1-d2f5-48e0-9bbe-b677c14fe5b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] Calling method '.version_select at 0x7fade40fa8b0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:52.667811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6343a2b1-d2f5-48e0-9bbe-b677c14fe5b6 tempest-TestShelveInstance-212907383 tempest-TestShelveInstance-212907383-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-457451613" status: 202 len: 0 microversion: 2.1 time: 0.048057 Jun 29 08:48:52.670747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 586/1127] 10.222.0.27 () {58 vars in 1250 bytes} [Wed Jun 29 08:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-457451613 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:48:52.858458 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8e5a849e-460f-4d1f-8d0b-7e995d0ab3d9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:52.859692 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8e5a849e-460f-4d1f-8d0b-7e995d0ab3d9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:52.870088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8e5a849e-460f-4d1f-8d0b-7e995d0ab3d9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:52.870530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8e5a849e-460f-4d1f-8d0b-7e995d0ab3d9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:52.880426 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8e5a849e-460f-4d1f-8d0b-7e995d0ab3d9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:52.880930 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8e5a849e-460f-4d1f-8d0b-7e995d0ab3d9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:52.915496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8e5a849e-460f-4d1f-8d0b-7e995d0ab3d9 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061611 Jun 29 08:48:52.921621 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 542/1128] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:48:52 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:48:52.984161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:52.989364 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:53.008630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bcaaa574-c2eb-4c63-95bc-8e192ce64c85 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:53.010597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bcaaa574-c2eb-4c63-95bc-8e192ce64c85 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:53.013836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:53.014288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:53.015104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:53.018043 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:53.025859 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bcaaa574-c2eb-4c63-95bc-8e192ce64c85 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:53.026834 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bcaaa574-c2eb-4c63-95bc-8e192ce64c85 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:53.028696 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bcaaa574-c2eb-4c63-95bc-8e192ce64c85 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:53.029272 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-bcaaa574-c2eb-4c63-95bc-8e192ce64c85 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:53.088717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-bcaaa574-c2eb-4c63-95bc-8e192ce64c85 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:48:53.094642 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:53.095338 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:53.095983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lazy-loading 'fault' on Instance uuid 5f64cb6c-8320-480e-b79c-bb55a51513b8 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:48:53.099563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:48:53.151214 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:53.160494 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:53.162877 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37d6c5d1f76445499566472213f13e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3addc279ffb4a49b379a938b1fbed3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:53.164258 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-07b4c3c1-4131-4c5b-b87b-d2711f2db9e9 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 200 len: 1372 microversion: 2.20 time: 0.186347 Jun 29 08:48:53.177279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 587/1129] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:48:52 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:48:53.222922 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bcaaa574-c2eb-4c63-95bc-8e192ce64c85 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 204 len: 0 microversion: 2.1 time: 0.222851 Jun 29 08:48:53.224113 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 543/1130] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:48:52 2022] DELETE /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:48:53.232830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8b7a82db-7236-422f-857c-92e6e370397b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:53.233440 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8b7a82db-7236-422f-857c-92e6e370397b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:53.242174 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8b7a82db-7236-422f-857c-92e6e370397b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:53.242909 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8b7a82db-7236-422f-857c-92e6e370397b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:53.243850 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8b7a82db-7236-422f-857c-92e6e370397b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:53.244580 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8b7a82db-7236-422f-857c-92e6e370397b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:53.393291 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8b7a82db-7236-422f-857c-92e6e370397b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:53.401618 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8b7a82db-7236-422f-857c-92e6e370397b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1681 microversion: 2.1 time: 0.172786 Jun 29 08:48:53.402196 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 588/1131] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:53 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:54.184253 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:54.184764 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:54.193127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:54.193800 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:54.194859 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:54.195356 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:54.211927 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] HTTP exception thrown: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Request method failure captured: Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 HTTP/1.1 Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7JzyS0A90bJs40JO9rP6Jdha-y5pzziLVUX-LwPQgIc9FKtSyCVmH_OqiJn62TvbwkiWwUJ8v03ehzXbQQmlfmqo_pvELEaZZ8yXKL9sh9rjOp6ohtKVzoWsnQ2tpBXqfpR3Ism9vtuAq5ItfEtehmAcNbHl4s-fy1wdIXyH6rBbA Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:48:54.213693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3addc279ffb4a49b379a938b1fbed3c"}]}] Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 37d6c5d1f76445499566472213f13e3a Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:54.215589 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '5f64cb6c-8320-480e-b79c-bb55a51513b8'} Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:48:54.216332 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:54.217520 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:54.218659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Returning 404 to user: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:48:54.218659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c8316642-d202-4ea7-86fb-432fc21e0c12 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 404 len: 111 microversion: 2.20 time: 0.035932 Jun 29 08:48:54.218659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 544/1132] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:48:54 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:48:54.224810 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-447b96da-ee78-4c7e-bc4f-2ccca4a8e975 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '.version_select at 0x7faddef26ca0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:54.246414 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-447b96da-ee78-4c7e-bc4f-2ccca4a8e975 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569604800" status: 204 len: 0 microversion: 2.20 time: 0.025183 Jun 29 08:48:54.247109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 589/1133] 10.222.0.27 () {60 vars in 1261 bytes} [Wed Jun 29 08:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569604800 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 29 08:48:54.419235 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5003d31d-97d1-4177-8edd-518855d76ed5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:54.419968 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5003d31d-97d1-4177-8edd-518855d76ed5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:54.426836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5003d31d-97d1-4177-8edd-518855d76ed5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:54.427280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5003d31d-97d1-4177-8edd-518855d76ed5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:54.428026 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5003d31d-97d1-4177-8edd-518855d76ed5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:54.428448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-5003d31d-97d1-4177-8edd-518855d76ed5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:54.580026 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5003d31d-97d1-4177-8edd-518855d76ed5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:54.587524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5003d31d-97d1-4177-8edd-518855d76ed5 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1681 microversion: 2.1 time: 0.172164 Jun 29 08:48:54.588482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 545/1134] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:54 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:55.606498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e4e3d474-0385-499a-a029-6e53b1b345de tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:55.607125 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e4e3d474-0385-499a-a029-6e53b1b345de tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:55.614569 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4e3d474-0385-499a-a029-6e53b1b345de tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:55.615047 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4e3d474-0385-499a-a029-6e53b1b345de tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:55.615842 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4e3d474-0385-499a-a029-6e53b1b345de tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:55.616275 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4e3d474-0385-499a-a029-6e53b1b345de tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:55.762131 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e4e3d474-0385-499a-a029-6e53b1b345de tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:55.773261 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e4e3d474-0385-499a-a029-6e53b1b345de tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1681 microversion: 2.1 time: 0.171151 Jun 29 08:48:55.775208 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 590/1135] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:55 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:56.280294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:56.281548 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:56.289715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:56.290782 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:56.291894 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:56.292481 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:56.321779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] HTTP exception thrown: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Request method failure captured: Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 HTTP/1.1 Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7JzyS0A90bJs40JO9rP6Jdha-y5pzziLVUX-LwPQgIc9FKtSyCVmH_OqiJn62TvbwkiWwUJ8v03ehzXbQQmlfmqo_pvELEaZZ8yXKL9sh9rjOp6ohtKVzoWsnQ2tpBXqfpR3Ism9vtuAq5ItfEtehmAcNbHl4s-fy1wdIXyH6rBbA Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:48:56.323442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3addc279ffb4a49b379a938b1fbed3c"}]}] Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 37d6c5d1f76445499566472213f13e3a Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.325088 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '5f64cb6c-8320-480e-b79c-bb55a51513b8'} Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:48:56.325916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.327319 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.329357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Returning 404 to user: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:48:56.330385 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e9242dea-5645-4dd7-b674-7e7591ff957c tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 404 len: 111 microversion: 2.20 time: 0.055831 Jun 29 08:48:56.331721 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 546/1136] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Jun 29 08:48:56 2022] DELETE /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:48:56.339872 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:56.340774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: 5f64cb6c-8320-480e-b79c-bb55a51513b8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:56.347569 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:56.348256 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:56.349200 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:56.349787 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:56.371548 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] HTTP exception thrown: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Request method failure captured: Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 HTTP/1.1 Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7JzyS0A90bJs40JO9rP6Jdha-y5pzziLVUX-LwPQgIc9FKtSyCVmH_OqiJn62TvbwkiWwUJ8v03ehzXbQQmlfmqo_pvELEaZZ8yXKL9sh9rjOp6ohtKVzoWsnQ2tpBXqfpR3Ism9vtuAq5ItfEtehmAcNbHl4s-fy1wdIXyH6rBbA Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:48:56.373231 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3addc279ffb4a49b379a938b1fbed3c"}]}] Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 37d6c5d1f76445499566472213f13e3a Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.374942 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '5f64cb6c-8320-480e-b79c-bb55a51513b8'} Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:48:56.379439 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. Jun 29 08:48:56.381248 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:56.383587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Returning 404 to user: Instance 5f64cb6c-8320-480e-b79c-bb55a51513b8 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:48:56.383587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e05dac47-999b-47f3-9c59-7a8dac15d9ea tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8" status: 404 len: 111 microversion: 2.20 time: 0.039756 Jun 29 08:48:56.383587 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 591/1137] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:48:56 2022] GET /compute/v2.1/servers/5f64cb6c-8320-480e-b79c-bb55a51513b8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:48:56.799241 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-86ff0b76-ef6f-4c92-8502-2f5b072ff596 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:56.800937 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-86ff0b76-ef6f-4c92-8502-2f5b072ff596 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:56.809410 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-86ff0b76-ef6f-4c92-8502-2f5b072ff596 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:56.809972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-86ff0b76-ef6f-4c92-8502-2f5b072ff596 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:56.811018 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-86ff0b76-ef6f-4c92-8502-2f5b072ff596 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:56.811496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-86ff0b76-ef6f-4c92-8502-2f5b072ff596 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:56.959049 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-86ff0b76-ef6f-4c92-8502-2f5b072ff596 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf002d9da34d1dad0ee71b5b7bb1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94b91ae9ee464aa2f5e24f5e8e0f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:48:56.969352 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-86ff0b76-ef6f-4c92-8502-2f5b072ff596 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 200 len: 1614 microversion: 2.1 time: 0.181591 Jun 29 08:48:56.970258 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 547/1138] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:56 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 1614 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:48:57.092372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-a29ad937-b2d8-47de-8f79-686cd27f0015 req-2a1554a2-2d7c-41dd-a039-4255ea0b7731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd356b2c-5d79-440e-9710-0e7808621c28", "name": "network-vif-deleted", "tag": "365adfee-4d17-44f7-9396-323504eaff0c"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:48:57.112180 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a29ad937-b2d8-47de-8f79-686cd27f0015 req-2a1554a2-2d7c-41dd-a039-4255ea0b7731 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:57.112645 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a29ad937-b2d8-47de-8f79-686cd27f0015 req-2a1554a2-2d7c-41dd-a039-4255ea0b7731 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:57.124356 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-a29ad937-b2d8-47de-8f79-686cd27f0015 req-2a1554a2-2d7c-41dd-a039-4255ea0b7731 service nova] Creating event network-vif-deleted:365adfee-4d17-44f7-9396-323504eaff0c for instance dd356b2c-5d79-440e-9710-0e7808621c28 on hv-cinder-79760 Jun 29 08:48:57.132117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-a29ad937-b2d8-47de-8f79-686cd27f0015 req-2a1554a2-2d7c-41dd-a039-4255ea0b7731 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046329 Jun 29 08:48:57.133724 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 592/1139] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:48:57.608474 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:57.609545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:57.616508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:57.617211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:57.618284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:57.618896 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:57.633461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] HTTP exception thrown: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Request method failure captured: Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 HTTP/1.1 Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7JzyS0A90bJs40JO9rP6Jdha-y5pzziLVUX-LwPQgIc9FKtSyCVmH_OqiJn62TvbwkiWwUJ8v03ehzXbQQmlfmqo_pvELEaZZ8yXKL9sh9rjOp6ohtKVzoWsnQ2tpBXqfpR3Ism9vtuAq5ItfEtehmAcNbHl4s-fy1wdIXyH6rBbA Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:48:57.635062 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3addc279ffb4a49b379a938b1fbed3c"}]}] Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 37d6c5d1f76445499566472213f13e3a Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.636780 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'dcdb4aec-5168-4f28-b336-45afe2620e64'} Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:48:57.637687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.639157 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.641265 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Returning 404 to user: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:48:57.642275 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-adc61dbd-cdff-47da-85a6-a8df33073ad5 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 404 len: 111 microversion: 2.20 time: 0.037984 Jun 29 08:48:57.646295 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 548/1140] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Jun 29 08:48:57 2022] DELETE /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 29 08:48:57.653961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:57.655719 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] [instance: dcdb4aec-5168-4f28-b336-45afe2620e64] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:57.665286 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:57.665827 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:57.666631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:57.667137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:57.683832 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] HTTP exception thrown: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Request method failure captured: Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 HTTP/1.1 Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7JzyS0A90bJs40JO9rP6Jdha-y5pzziLVUX-LwPQgIc9FKtSyCVmH_OqiJn62TvbwkiWwUJ8v03ehzXbQQmlfmqo_pvELEaZZ8yXKL9sh9rjOp6ohtKVzoWsnQ2tpBXqfpR3Ism9vtuAq5ItfEtehmAcNbHl4s-fy1wdIXyH6rBbA Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:48:57.685511 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3addc279ffb4a49b379a938b1fbed3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3addc279ffb4a49b379a938b1fbed3c"}]}] Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c3addc279ffb4a49b379a938b1fbed3c Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199087944 Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 37d6c5d1f76445499566472213f13e3a Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199087944-project Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.687124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'dcdb4aec-5168-4f28-b336-45afe2620e64'} Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:48:57.688109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. Jun 29 08:48:57.689631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:48:57.691544 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] Returning 404 to user: Instance dcdb4aec-5168-4f28-b336-45afe2620e64 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:48:57.691544 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-74b8a216-c8c5-42a1-b8eb-dfdfd66a3ad2 tempest-AttachVolumeShelveTestJSON-199087944 tempest-AttachVolumeShelveTestJSON-199087944-project] 10.222.0.27 "GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64" status: 404 len: 111 microversion: 2.20 time: 0.039354 Jun 29 08:48:57.691544 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 593/1141] 10.222.0.27 () {60 vars in 1276 bytes} [Wed Jun 29 08:48:57 2022] GET /compute/v2.1/servers/dcdb4aec-5168-4f28-b336-45afe2620e64 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 29 08:48:57.987986 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:57.988594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:57.996276 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:57.997128 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:57.998132 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:57.998804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:58.013793 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 HTTP/1.1 Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:48:58.020836 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:48:58.022526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'dd356b2c-5d79-440e-9710-0e7808621c28'} Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:48:58.023530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:48:58.024964 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:48:58.026238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:48:58.026238 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-49d1c61d-9a27-4fe2-911c-c6d4ab7b3477 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 404 len: 111 microversion: 2.1 time: 0.040598 Jun 29 08:48:58.028817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 549/1142] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:48:57 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:48:58.033880 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a66877c8-bdc2-4ebb-a1f0-68f90dc3f6d4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '.version_select at 0x7fade417e040>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:58.058033 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a66877c8-bdc2-4ebb-a1f0-68f90dc3f6d4 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-911874527" status: 202 len: 0 microversion: 2.1 time: 0.027862 Jun 29 08:48:58.058960 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 594/1143] 10.222.0.27 () {58 vars in 1217 bytes} [Wed Jun 29 08:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-911874527 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:48:59.087264 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-fef8aee1-d038-4685-b2c7-8150594985d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:48:59.089539 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fef8aee1-d038-4685-b2c7-8150594985d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:48:59.100099 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fef8aee1-d038-4685-b2c7-8150594985d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:59.101420 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fef8aee1-d038-4685-b2c7-8150594985d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:59.104321 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fef8aee1-d038-4685-b2c7-8150594985d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:48:59.104921 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fef8aee1-d038-4685-b2c7-8150594985d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:48:59.195845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-fef8aee1-d038-4685-b2c7-8150594985d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lazy-loading 'services' on Instance uuid 1496b38e-1b75-490e-a93b-cf84acb22ef8 {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:48:59.292973 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-fef8aee1-d038-4685-b2c7-8150594985d1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/os-volume_attachments/fc86a6e8-85e5-469d-8c24-2560347b26eb" status: 202 len: 0 microversion: 2.1 time: 0.208137 Jun 29 08:48:59.295212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 550/1144] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:48:59 2022] DELETE /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/os-volume_attachments/fc86a6e8-85e5-469d-8c24-2560347b26eb => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:49:00.485412 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fa62fd5d-0643-4a0f-8fee-911c52daad63 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:00.494374 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa62fd5d-0643-4a0f-8fee-911c52daad63 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:00.495091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa62fd5d-0643-4a0f-8fee-911c52daad63 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:00.521765 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fa62fd5d-0643-4a0f-8fee-911c52daad63 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Going to try to stop instance {{(pid=124266) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 08:49:00.574095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fa62fd5d-0643-4a0f-8fee-911c52daad63 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/action" status: 202 len: 0 microversion: 2.1 time: 0.092589 Jun 29 08:49:00.586937 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-39216839-8c66-411f-bfc8-9a885dad6ffe tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:00.587687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-39216839-8c66-411f-bfc8-9a885dad6ffe tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:00.588746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 595/1145] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:49:00 2022] POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:49:00.595541 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:00.595950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39216839-8c66-411f-bfc8-9a885dad6ffe tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:00.596680 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39216839-8c66-411f-bfc8-9a885dad6ffe tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:00.596916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:00.597518 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39216839-8c66-411f-bfc8-9a885dad6ffe tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:00.597948 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-39216839-8c66-411f-bfc8-9a885dad6ffe tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:00.605716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:00.606190 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:00.606984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:00.607408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:00.611563 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:49:00.621553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 HTTP/1.1 Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:49:00.623257 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.624673 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'dd356b2c-5d79-440e-9710-0e7808621c28'} Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:00.625491 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.626800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.628183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:00.628183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8898b202-b4d9-4deb-8c8d-aa34205b4d9f tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 404 len: 111 microversion: 2.1 time: 0.034160 Jun 29 08:49:00.628553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 596/1146] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:49:00 2022] DELETE /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:00.644969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:00.645852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: dd356b2c-5d79-440e-9710-0e7808621c28] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:00.653612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:00.654538 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:00.655552 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:00.656138 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:00.677119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 HTTP/1.1 Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:49:00.678811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.680181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'dd356b2c-5d79-440e-9710-0e7808621c28'} Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:00.680961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. Jun 29 08:49:00.682664 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:00.684221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance dd356b2c-5d79-440e-9710-0e7808621c28 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:00.684221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-28800626-9532-4e62-88cc-1bd09ad2a4a0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28" status: 404 len: 111 microversion: 2.1 time: 0.050448 Jun 29 08:49:00.684221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 597/1147] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:00 2022] GET /compute/v2.1/servers/dd356b2c-5d79-440e-9710-0e7808621c28 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:00.823941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-39216839-8c66-411f-bfc8-9a885dad6ffe tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:00.841458 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-39216839-8c66-411f-bfc8-9a885dad6ffe tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.261584 Jun 29 08:49:00.854463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 551/1148] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:00 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:01.859299 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2b71f688-444b-49f9-92d1-5a4e51d27860 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:01.859903 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2b71f688-444b-49f9-92d1-5a4e51d27860 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:01.866890 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b71f688-444b-49f9-92d1-5a4e51d27860 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:01.868008 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b71f688-444b-49f9-92d1-5a4e51d27860 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:01.868963 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b71f688-444b-49f9-92d1-5a4e51d27860 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:01.869586 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b71f688-444b-49f9-92d1-5a4e51d27860 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:01.903326 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:01.904421 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:01.911341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:01.912041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:01.912984 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:01.913585 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:01.928297 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 HTTP/1.1 Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:01.929991 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.931392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9'} Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:01.932136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.933336 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.934563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:01.934563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-29ae5d63-9fb7-44e9-8ebf-253cbc2bb1e0 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 404 len: 111 microversion: 2.1 time: 0.031965 Jun 29 08:49:01.934563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 552/1149] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:49:01 2022] DELETE /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:01.939773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:01.940456 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:01.947992 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:01.948439 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:01.949211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:01.949640 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:01.965807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 HTTP/1.1 Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:01.967577 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.968990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9'} Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:01.971091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. Jun 29 08:49:01.972935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:01.974492 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:01.974492 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-26f44124-dc3e-4ca9-8145-92b49ba1d85c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9" status: 404 len: 111 microversion: 2.1 time: 0.033181 Jun 29 08:49:01.974492 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 553/1150] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:01 2022] GET /compute/v2.1/servers/f4bda473-95ff-4f3c-b33c-7c12ba1cc1b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:01.980697 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:01.981355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:01.991912 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:01.992654 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:01.993587 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:01.994199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:02.012987 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 HTTP/1.1 Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:02.014556 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.016022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '1cd027a5-b0e0-4883-a88f-a55e9fdb57f0'} Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:02.016794 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.017980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.019267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:02.019267 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a8bb7b64-f5c2-4270-a3ec-e6e6f7b3362b tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 404 len: 111 microversion: 2.1 time: 0.041342 Jun 29 08:49:02.019754 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 554/1151] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:49:01 2022] DELETE /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:02.025100 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:02.026022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:02.032700 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:02.033182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:02.034045 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:02.034481 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:02.036883 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2b71f688-444b-49f9-92d1-5a4e51d27860 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:02.047238 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2b71f688-444b-49f9-92d1-5a4e51d27860 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.191732 Jun 29 08:49:02.048108 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 598/1152] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:01 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:02.051269 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 HTTP/1.1 Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:02.052845 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.054480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '1cd027a5-b0e0-4883-a88f-a55e9fdb57f0'} Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:02.055457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. Jun 29 08:49:02.056953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:02.059089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance 1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:02.059089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-698d202b-a2a0-42d1-a1de-0ac42238dbe3 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0" status: 404 len: 111 microversion: 2.1 time: 0.033345 Jun 29 08:49:02.059089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 555/1153] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:02 2022] GET /compute/v2.1/servers/1cd027a5-b0e0-4883-a88f-a55e9fdb57f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:03.066648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3a5d772e-50fb-465a-affe-1284b0ee9333 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:03.067306 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3a5d772e-50fb-465a-affe-1284b0ee9333 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:03.073875 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3a5d772e-50fb-465a-affe-1284b0ee9333 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:03.074313 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3a5d772e-50fb-465a-affe-1284b0ee9333 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:03.075111 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3a5d772e-50fb-465a-affe-1284b0ee9333 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:03.075530 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3a5d772e-50fb-465a-affe-1284b0ee9333 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:03.214754 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3a5d772e-50fb-465a-affe-1284b0ee9333 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:03.219892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:03.220376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:03.223987 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3a5d772e-50fb-465a-affe-1284b0ee9333 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.161771 Jun 29 08:49:03.224961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 599/1154] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:03 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:03.227355 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:03.227806 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:03.228626 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:03.229048 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:03.243563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 HTTP/1.1 Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:03.245176 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.246804 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '16ff4bf7-d905-4584-98f7-26236c14a7d8'} Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:03.247604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.248848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.250323 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:03.250323 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-be41a7c3-20e1-4421-ab1b-c615f871fa3c tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 404 len: 111 microversion: 2.1 time: 0.037723 Jun 29 08:49:03.250323 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 556/1155] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:49:03 2022] DELETE /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:49:03.255349 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:03.255965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] [instance: 16ff4bf7-d905-4584-98f7-26236c14a7d8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:03.261988 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:03.262569 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:03.263363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:03.263792 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:03.277394 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] HTTP exception thrown: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Request method failure captured: Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 HTTP/1.1 Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA7DmX07ZM4ij6Vn0VW_aMAKOX1XQBECJtL84KrzsZ6SfPtOPDhlW0XhbwUK5oYMtSsU-bnR6W9QTbbcOcYXP2Kxw7Zz3YQpUDVc2f_9Wq_XVfDRsKXshKbQ6YgdgmdK-cy_oQSs1vHT93B_m7d4n-CZdrqVUiAvjGiALu24Ei7egBs Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:49:03.278977 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f94b91ae9ee464aa2f5e24f5e8e0f7b"}]}] Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 8f94b91ae9ee464aa2f5e24f5e8e0f7b Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-83780565 Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: bccf002d9da34d1dad0ee71b5b7bb1c1 Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-83780565-project Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.280572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '16ff4bf7-d905-4584-98f7-26236c14a7d8'} Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:03.281648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. Jun 29 08:49:03.283186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:03.284747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] Returning 404 to user: Instance 16ff4bf7-d905-4584-98f7-26236c14a7d8 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:03.284747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f6c97b0c-2b5d-47eb-9a24-1af19e2eea37 tempest-AttachVolumeNegativeTest-83780565 tempest-AttachVolumeNegativeTest-83780565-project] 10.222.0.27 "GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8" status: 404 len: 111 microversion: 2.1 time: 0.029050 Jun 29 08:49:03.284747 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 600/1156] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:03 2022] GET /compute/v2.1/servers/16ff4bf7-d905-4584-98f7-26236c14a7d8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:04.241605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8736d980-8cd2-4377-99ba-7c9c5eb22953 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:04.242436 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8736d980-8cd2-4377-99ba-7c9c5eb22953 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:04.249083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8736d980-8cd2-4377-99ba-7c9c5eb22953 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:04.249526 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8736d980-8cd2-4377-99ba-7c9c5eb22953 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:04.250290 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8736d980-8cd2-4377-99ba-7c9c5eb22953 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:04.250722 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8736d980-8cd2-4377-99ba-7c9c5eb22953 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:04.496652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-8736d980-8cd2-4377-99ba-7c9c5eb22953 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:04.504635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8736d980-8cd2-4377-99ba-7c9c5eb22953 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.267075 Jun 29 08:49:04.505200 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 557/1157] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:04 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:05.521634 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74261ed8-35a5-46fc-9c4b-14326a40ca09 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:05.523222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-74261ed8-35a5-46fc-9c4b-14326a40ca09 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:05.531430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74261ed8-35a5-46fc-9c4b-14326a40ca09 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:05.532050 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74261ed8-35a5-46fc-9c4b-14326a40ca09 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:05.533019 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74261ed8-35a5-46fc-9c4b-14326a40ca09 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:05.533589 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74261ed8-35a5-46fc-9c4b-14326a40ca09 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:05.738479 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-74261ed8-35a5-46fc-9c4b-14326a40ca09 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:05.746992 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-74261ed8-35a5-46fc-9c4b-14326a40ca09 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.229420 Jun 29 08:49:05.747824 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 601/1158] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:05 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:06.769338 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ce64ce76-47e9-41f0-9cbf-cea3360e3c4f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:06.770847 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ce64ce76-47e9-41f0-9cbf-cea3360e3c4f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:06.778945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ce64ce76-47e9-41f0-9cbf-cea3360e3c4f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:06.779785 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ce64ce76-47e9-41f0-9cbf-cea3360e3c4f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:06.780741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ce64ce76-47e9-41f0-9cbf-cea3360e3c4f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:06.781368 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ce64ce76-47e9-41f0-9cbf-cea3360e3c4f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:07.013848 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ce64ce76-47e9-41f0-9cbf-cea3360e3c4f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:07.024516 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ce64ce76-47e9-41f0-9cbf-cea3360e3c4f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.263595 Jun 29 08:49:07.025025 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 558/1159] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:06 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:08.042843 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-28f1e10f-9148-4643-a9b8-98a682a80e2a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:08.043612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-28f1e10f-9148-4643-a9b8-98a682a80e2a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:08.046203 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:49:08.053531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-28f1e10f-9148-4643-a9b8-98a682a80e2a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:08.053531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-28f1e10f-9148-4643-a9b8-98a682a80e2a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:08.053531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-28f1e10f-9148-4643-a9b8-98a682a80e2a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:08.054137 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-28f1e10f-9148-4643-a9b8-98a682a80e2a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:08.199159 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-28f1e10f-9148-4643-a9b8-98a682a80e2a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:08.206636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-28f1e10f-9148-4643-a9b8-98a682a80e2a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.168213 Jun 29 08:49:08.207483 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 602/1160] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:08 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:08.435954 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-38294beb-e3f8-4fdb-acad-d65bb70c45e6 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Action: 'create', calling method: .version_select at 0x7fade416ad30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-336999693", "metadata": {"Type": "work"}}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-38294beb-e3f8-4fdb-acad-d65bb70c45e6 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Request method failure captured: Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 121 Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivBIEUU0YXM97IKcMrhMn4uh7v4jMgcbuMdj_AXpB65IyN1_ZMdvwjIaQ6RXXGvKHsjThbGO4WD-scwbcgZDg_SGwmxCdcnFsyvUsfJI2TFcIjZud0uKgKLFdGMWpjl3pKWX-VPGkIgpZ3zaCTHLAGUVENBE0JNSZ4ZPEG8GwTHnRKR0 Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:08.455568 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3033741be8842ca884bf6580397d453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3033741be8842ca884bf6580397d453"}]}] Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: e24730e01a38440b82fb24e4d85a9407 Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-336999693", "metadata": {"Type": "work"}}} Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: Jun 29 08:49:08.457454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-336999693', 'metadata': {'Type': 'work'}}}} Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise error Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi '#$%' Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:08.462681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 08:49:08.464704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 08:49:08.466645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 08:49:08.466645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.466645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-38294beb-e3f8-4fdb-acad-d65bb70c45e6 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:08.466645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-38294beb-e3f8-4fdb-acad-d65bb70c45e6 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.155912 Jun 29 08:49:08.466645 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 559/1161] 10.222.0.27 () {60 vars in 1155 bytes} [Wed Jun 29 08:49:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:49:08.467628 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-017fbe17-8edb-4b51-ace6-c3a2c92ce391 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Action: 'create', calling method: .version_select at 0x7fade40fa5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-819755082", "metadata": {"Type": "work"}}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-017fbe17-8edb-4b51-ace6-c3a2c92ce391 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Request method failure captured: Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 119 Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBIEUU0YXM97IKcMrhMn4uh7v4jMgcbuMdj_AXpB65IyN1_ZMdvwjIaQ6RXXGvKHsjThbGO4WD-scwbcgZDg_SGwmxCdcnFsyvUsfJI2TFcIjZud0uKgKLFdGMWpjl3pKWX-VPGkIgpZ3zaCTHLAGUVENBE0JNSZ4ZPEG8GwTHnRKR0 Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:49:08.470917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3033741be8842ca884bf6580397d453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3033741be8842ca884bf6580397d453"}]}] Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: e24730e01a38440b82fb24e4d85a9407 Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-819755082", "metadata": {"Type": "work"}}} Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: Jun 29 08:49:08.472498 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-819755082', 'metadata': {'Type': 'work'}}}} Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise error Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi '0' Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:08.475836 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 08:49:08.477271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 08:49:08.478672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 08:49:08.478672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.478672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-017fbe17-8edb-4b51-ace6-c3a2c92ce391 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:08.478672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-017fbe17-8edb-4b51-ace6-c3a2c92ce391 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009617 Jun 29 08:49:08.478672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 603/1162] 10.222.0.27 () {60 vars in 1155 bytes} [Wed Jun 29 08:49:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 29 08:49:08.482659 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ea45c347-4382-44c0-9355-11b21e361fc8 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Action: 'create', calling method: .version_select at 0x7fade421a670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-357724030", "metadata": {"Type": "work"}}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ea45c347-4382-44c0-9355-11b21e361fc8 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Request method failure captured: Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 118 Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivBIEUU0YXM97IKcMrhMn4uh7v4jMgcbuMdj_AXpB65IyN1_ZMdvwjIaQ6RXXGvKHsjThbGO4WD-scwbcgZDg_SGwmxCdcnFsyvUsfJI2TFcIjZud0uKgKLFdGMWpjl3pKWX-VPGkIgpZ3zaCTHLAGUVENBE0JNSZ4ZPEG8GwTHnRKR0 Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:08.485274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3033741be8842ca884bf6580397d453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3033741be8842ca884bf6580397d453"}]}] Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: e24730e01a38440b82fb24e4d85a9407 Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-357724030", "metadata": {"Type": "work"}}} Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: Jun 29 08:49:08.486867 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-357724030', 'metadata': {'Type': 'work'}}}} Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise error Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi '' Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:08.488688 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 08:49:08.490153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 08:49:08.491484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 08:49:08.491484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.491484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ea45c347-4382-44c0-9355-11b21e361fc8 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:08.491484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ea45c347-4382-44c0-9355-11b21e361fc8 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007900 Jun 29 08:49:08.491484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 560/1163] 10.222.0.27 () {60 vars in 1155 bytes} [Wed Jun 29 08:49:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 29 08:49:08.497164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8c4b6f48-0bd2-4534-a41d-b56c11b4b402 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Calling method '.version_select at 0x7fade40f4b80>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:08.526111 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-8c4b6f48-0bd2-4534-a41d-b56c11b4b402 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] HTTP exception thrown: Volume tempest-invalid-1081132769 could not be found. Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8c4b6f48-0bd2-4534-a41d-b56c11b4b402 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Request method failure captured: Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1081132769 HTTP/1.1 Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBIEUU0YXM97IKcMrhMn4uh7v4jMgcbuMdj_AXpB65IyN1_ZMdvwjIaQ6RXXGvKHsjThbGO4WD-scwbcgZDg_SGwmxCdcnFsyvUsfJI2TFcIjZud0uKgKLFdGMWpjl3pKWX-VPGkIgpZ3zaCTHLAGUVENBE0JNSZ4ZPEG8GwTHnRKR0 Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:49:08.528857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3033741be8842ca884bf6580397d453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3033741be8842ca884bf6580397d453"}]}] Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: e24730e01a38440b82fb24e4d85a9407 Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Volume tempest-invalid-1081132769 could not be found. Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'tempest-invalid-1081132769'} Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:08.530516 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1081132769 could not be found. (HTTP 404) (Request-ID: req-884176c7-f9df-48e0-9946-6ae8374b6d89) Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.531609 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:49:08.533056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1081132769 could not be found. Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:08.534408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1081132769 could not be found. Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1081132769 could not be found. Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8c4b6f48-0bd2-4534-a41d-b56c11b4b402 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Returning 404 to user: Volume tempest-invalid-1081132769 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8c4b6f48-0bd2-4534-a41d-b56c11b4b402 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1081132769" status: 404 len: 99 microversion: 2.1 time: 0.037172 Jun 29 08:49:08.536024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 604/1164] 10.222.0.27 () {58 vars in 1217 bytes} [Wed Jun 29 08:49:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1081132769 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 29 08:49:08.541232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b4cb6f83-d610-411f-b8ad-54d699a72851 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003760 Jun 29 08:49:08.541747 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 561/1165] 10.222.0.27 () {58 vars in 1139 bytes} [Wed Jun 29 08:49:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 08:49:08.552157 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7ab888d9-27f0-4b3c-9aaf-1cfdc062f9c3 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004692 Jun 29 08:49:08.552785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 605/1166] 10.222.0.27 () {58 vars in 1136 bytes} [Wed Jun 29 08:49:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 08:49:08.562915 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3398bbac-91ef-4a1b-b93c-ff18e39a8609 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Calling method '.version_select at 0x7fade421a790>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:08.594455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-3398bbac-91ef-4a1b-b93c-ff18e39a8609 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] HTTP exception thrown: Volume 621d1baf-c140-421e-b2b9-6e5624d13577 could not be found. Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3398bbac-91ef-4a1b-b93c-ff18e39a8609 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Request method failure captured: Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/os-volumes/621d1baf-c140-421e-b2b9-6e5624d13577 HTTP/1.1 Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivBIEUU0YXM97IKcMrhMn4uh7v4jMgcbuMdj_AXpB65IyN1_ZMdvwjIaQ6RXXGvKHsjThbGO4WD-scwbcgZDg_SGwmxCdcnFsyvUsfJI2TFcIjZud0uKgKLFdGMWpjl3pKWX-VPGkIgpZ3zaCTHLAGUVENBE0JNSZ4ZPEG8GwTHnRKR0 Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:08.597081 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3033741be8842ca884bf6580397d453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3033741be8842ca884bf6580397d453"}]}] Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: e24730e01a38440b82fb24e4d85a9407 Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Volume 621d1baf-c140-421e-b2b9-6e5624d13577 could not be found. Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '621d1baf-c140-421e-b2b9-6e5624d13577'} Jun 29 08:49:08.598624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 621d1baf-c140-421e-b2b9-6e5624d13577 could not be found. (HTTP 404) (Request-ID: req-741de9db-cdf3-4c72-912a-edc77a8705c1) Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.599969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:49:08.601534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 621d1baf-c140-421e-b2b9-6e5624d13577 could not be found. Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 08:49:08.602837 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 621d1baf-c140-421e-b2b9-6e5624d13577 could not be found. Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 621d1baf-c140-421e-b2b9-6e5624d13577 could not be found. Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3398bbac-91ef-4a1b-b93c-ff18e39a8609 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Returning 404 to user: Volume 621d1baf-c140-421e-b2b9-6e5624d13577 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3398bbac-91ef-4a1b-b93c-ff18e39a8609 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/621d1baf-c140-421e-b2b9-6e5624d13577" status: 404 len: 109 microversion: 2.1 time: 0.040948 Jun 29 08:49:08.604047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 562/1167] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:49:08 2022] DELETE /compute/v2.1/os-volumes/621d1baf-c140-421e-b2b9-6e5624d13577 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:08.609486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f3fc66c6-a9ba-46b4-88f3-8f41693edb00 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Calling method '.version_select at 0x7fade417e550>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:08.639793 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-f3fc66c6-a9ba-46b4-88f3-8f41693edb00 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] HTTP exception thrown: Volume 9cc8121e-0c5d-4311-a486-e86caa84a715 could not be found. Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f3fc66c6-a9ba-46b4-88f3-8f41693edb00 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Request method failure captured: Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/os-volumes/9cc8121e-0c5d-4311-a486-e86caa84a715 HTTP/1.1 Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBIEUU0YXM97IKcMrhMn4uh7v4jMgcbuMdj_AXpB65IyN1_ZMdvwjIaQ6RXXGvKHsjThbGO4WD-scwbcgZDg_SGwmxCdcnFsyvUsfJI2TFcIjZud0uKgKLFdGMWpjl3pKWX-VPGkIgpZ3zaCTHLAGUVENBE0JNSZ4ZPEG8GwTHnRKR0 Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:49:08.641821 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3033741be8842ca884bf6580397d453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3033741be8842ca884bf6580397d453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3033741be8842ca884bf6580397d453"}]}] Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a3033741be8842ca884bf6580397d453 Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-33462293 Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: e24730e01a38440b82fb24e4d85a9407 Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-33462293-project Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Volume 9cc8121e-0c5d-4311-a486-e86caa84a715 could not be found. Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '9cc8121e-0c5d-4311-a486-e86caa84a715'} Jun 29 08:49:08.643696 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9cc8121e-0c5d-4311-a486-e86caa84a715 could not be found. (HTTP 404) (Request-ID: req-f2f6ecda-5475-44a4-90f3-d5759c78e7ca) Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.644627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:49:08.645980 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9cc8121e-0c5d-4311-a486-e86caa84a715 could not be found. Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 08:49:08.647279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9cc8121e-0c5d-4311-a486-e86caa84a715 could not be found. Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9cc8121e-0c5d-4311-a486-e86caa84a715 could not be found. Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f3fc66c6-a9ba-46b4-88f3-8f41693edb00 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] Returning 404 to user: Volume 9cc8121e-0c5d-4311-a486-e86caa84a715 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f3fc66c6-a9ba-46b4-88f3-8f41693edb00 tempest-VolumesNegativeTest-33462293 tempest-VolumesNegativeTest-33462293-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9cc8121e-0c5d-4311-a486-e86caa84a715" status: 404 len: 109 microversion: 2.1 time: 0.038391 Jun 29 08:49:08.648446 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 606/1168] 10.222.0.27 () {58 vars in 1244 bytes} [Wed Jun 29 08:49:08 2022] GET /compute/v2.1/os-volumes/9cc8121e-0c5d-4311-a486-e86caa84a715 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:49:09.224790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-c87515dc-58a6-46cf-966e-45865f9a725a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:09.225455 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-c87515dc-58a6-46cf-966e-45865f9a725a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:09.232489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c87515dc-58a6-46cf-966e-45865f9a725a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:09.232934 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c87515dc-58a6-46cf-966e-45865f9a725a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:09.233754 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c87515dc-58a6-46cf-966e-45865f9a725a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:09.234182 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-c87515dc-58a6-46cf-966e-45865f9a725a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:09.386486 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-c87515dc-58a6-46cf-966e-45865f9a725a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:09.394390 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-c87515dc-58a6-46cf-966e-45865f9a725a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.173649 Jun 29 08:49:09.394996 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 563/1169] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:09 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:10.414084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-69afd817-08d1-40d5-afcc-fbcd54d18ab2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:10.414794 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-69afd817-08d1-40d5-afcc-fbcd54d18ab2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:10.421115 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-69afd817-08d1-40d5-afcc-fbcd54d18ab2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:10.421637 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-69afd817-08d1-40d5-afcc-fbcd54d18ab2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:10.422484 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-69afd817-08d1-40d5-afcc-fbcd54d18ab2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:10.423024 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-69afd817-08d1-40d5-afcc-fbcd54d18ab2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:10.560235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-69afd817-08d1-40d5-afcc-fbcd54d18ab2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:10.567913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-69afd817-08d1-40d5-afcc-fbcd54d18ab2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.159460 Jun 29 08:49:10.568474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 607/1170] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:10 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:11.585614 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d81c75c6-1330-47a4-b703-1af34ed03c60 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:11.586224 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d81c75c6-1330-47a4-b703-1af34ed03c60 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:11.588490 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:49:11.594624 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d81c75c6-1330-47a4-b703-1af34ed03c60 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:11.595193 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d81c75c6-1330-47a4-b703-1af34ed03c60 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:11.595941 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d81c75c6-1330-47a4-b703-1af34ed03c60 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:11.596379 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d81c75c6-1330-47a4-b703-1af34ed03c60 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:11.738165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d81c75c6-1330-47a4-b703-1af34ed03c60 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:11.745977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d81c75c6-1330-47a4-b703-1af34ed03c60 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.164486 Jun 29 08:49:11.746542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 564/1171] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:11 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:12.766228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-761026a1-1715-4c2c-bf0b-03679d655528 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:12.766228 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-761026a1-1715-4c2c-bf0b-03679d655528 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:12.772418 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-761026a1-1715-4c2c-bf0b-03679d655528 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:12.772859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-761026a1-1715-4c2c-bf0b-03679d655528 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:12.773677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-761026a1-1715-4c2c-bf0b-03679d655528 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:12.774162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-761026a1-1715-4c2c-bf0b-03679d655528 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:12.932850 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-761026a1-1715-4c2c-bf0b-03679d655528 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:12.942216 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-761026a1-1715-4c2c-bf0b-03679d655528 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.181355 Jun 29 08:49:12.942818 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 608/1172] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:12 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:13.960341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a03af4f2-9e72-4d21-83a8-d0bf305c6722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:13.960950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a03af4f2-9e72-4d21-83a8-d0bf305c6722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:13.968965 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a03af4f2-9e72-4d21-83a8-d0bf305c6722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:13.971165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a03af4f2-9e72-4d21-83a8-d0bf305c6722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:13.972563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a03af4f2-9e72-4d21-83a8-d0bf305c6722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:13.973042 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a03af4f2-9e72-4d21-83a8-d0bf305c6722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:14.118712 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a03af4f2-9e72-4d21-83a8-d0bf305c6722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:14.126284 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a03af4f2-9e72-4d21-83a8-d0bf305c6722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.170442 Jun 29 08:49:14.127201 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 565/1173] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:13 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:15.148150 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dc752721-2a64-4137-83d2-d637b7922d57 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:15.149138 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dc752721-2a64-4137-83d2-d637b7922d57 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:15.161866 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc752721-2a64-4137-83d2-d637b7922d57 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:15.162451 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc752721-2a64-4137-83d2-d637b7922d57 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:15.163324 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc752721-2a64-4137-83d2-d637b7922d57 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:15.163896 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc752721-2a64-4137-83d2-d637b7922d57 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:15.299763 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dc752721-2a64-4137-83d2-d637b7922d57 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:15.308331 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dc752721-2a64-4137-83d2-d637b7922d57 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.166841 Jun 29 08:49:15.308888 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 609/1174] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:15 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:16.330818 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-66f73ca3-938d-40ac-aab1-d391c1fbf4ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:16.331424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-66f73ca3-938d-40ac-aab1-d391c1fbf4ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:16.338104 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66f73ca3-938d-40ac-aab1-d391c1fbf4ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:16.338545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66f73ca3-938d-40ac-aab1-d391c1fbf4ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:16.339681 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66f73ca3-938d-40ac-aab1-d391c1fbf4ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:16.340109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-66f73ca3-938d-40ac-aab1-d391c1fbf4ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:16.477640 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-66f73ca3-938d-40ac-aab1-d391c1fbf4ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:16.486296 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-66f73ca3-938d-40ac-aab1-d391c1fbf4ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.159402 Jun 29 08:49:16.487072 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 566/1175] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:16 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:17.503591 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cb9ce805-3fb2-43f0-b027-454e48aee1d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:17.504237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cb9ce805-3fb2-43f0-b027-454e48aee1d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:17.511470 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb9ce805-3fb2-43f0-b027-454e48aee1d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:17.511916 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb9ce805-3fb2-43f0-b027-454e48aee1d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:17.512672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb9ce805-3fb2-43f0-b027-454e48aee1d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:17.513107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb9ce805-3fb2-43f0-b027-454e48aee1d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:17.644485 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cb9ce805-3fb2-43f0-b027-454e48aee1d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:17.653088 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cb9ce805-3fb2-43f0-b027-454e48aee1d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.153340 Jun 29 08:49:17.654153 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 610/1176] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:17 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:18.674744 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-aba4c35a-0f66-4213-8ec7-070557bace97 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:18.675743 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-aba4c35a-0f66-4213-8ec7-070557bace97 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:18.687306 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aba4c35a-0f66-4213-8ec7-070557bace97 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:18.688047 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aba4c35a-0f66-4213-8ec7-070557bace97 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:18.689299 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aba4c35a-0f66-4213-8ec7-070557bace97 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:18.690011 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-aba4c35a-0f66-4213-8ec7-070557bace97 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:18.829605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-aba4c35a-0f66-4213-8ec7-070557bace97 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:18.837348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-aba4c35a-0f66-4213-8ec7-070557bace97 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.169223 Jun 29 08:49:18.837884 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 567/1177] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:18 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:19.855957 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-575f46d7-496b-450a-9765-fdae2119e45f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:19.856564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-575f46d7-496b-450a-9765-fdae2119e45f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:19.863547 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-575f46d7-496b-450a-9765-fdae2119e45f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:19.864075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-575f46d7-496b-450a-9765-fdae2119e45f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:19.865011 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-575f46d7-496b-450a-9765-fdae2119e45f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:19.865508 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-575f46d7-496b-450a-9765-fdae2119e45f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:20.001803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-575f46d7-496b-450a-9765-fdae2119e45f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:20.010851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-575f46d7-496b-450a-9765-fdae2119e45f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1676 microversion: 2.1 time: 0.158880 Jun 29 08:49:20.011430 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 611/1178] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:19 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:21.029016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7f5d7c1b-647c-44af-9d6d-7746a7b34849 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:21.029630 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7f5d7c1b-647c-44af-9d6d-7746a7b34849 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:21.036534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f5d7c1b-647c-44af-9d6d-7746a7b34849 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:21.036990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f5d7c1b-647c-44af-9d6d-7746a7b34849 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:21.037760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f5d7c1b-647c-44af-9d6d-7746a7b34849 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:21.038205 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f5d7c1b-647c-44af-9d6d-7746a7b34849 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:21.042480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:49:21.174022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-7f5d7c1b-647c-44af-9d6d-7746a7b34849 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:21.185403 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7f5d7c1b-647c-44af-9d6d-7746a7b34849 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1653 microversion: 2.1 time: 0.160410 Jun 29 08:49:21.186240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 568/1179] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:21 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:21.211563 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-48fea081-2f14-4c17-ad79-95915c934225 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:21.219062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-48fea081-2f14-4c17-ad79-95915c934225 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:21.219510 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-48fea081-2f14-4c17-ad79-95915c934225 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:21.243211 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-48fea081-2f14-4c17-ad79-95915c934225 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Going to try to start instance {{(pid=124266) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 08:49:21.300010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-48fea081-2f14-4c17-ad79-95915c934225 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/action" status: 202 len: 0 microversion: 2.1 time: 0.094425 Jun 29 08:49:21.300614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 612/1180] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:49:21 2022] POST /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:49:21.309652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-076ced35-de33-423d-b756-dc9a4294c4d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:21.310263 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-076ced35-de33-423d-b756-dc9a4294c4d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:21.317463 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-076ced35-de33-423d-b756-dc9a4294c4d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:21.317849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-076ced35-de33-423d-b756-dc9a4294c4d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:21.318724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-076ced35-de33-423d-b756-dc9a4294c4d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:21.319213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-076ced35-de33-423d-b756-dc9a4294c4d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:21.475296 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-076ced35-de33-423d-b756-dc9a4294c4d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:21.483795 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-076ced35-de33-423d-b756-dc9a4294c4d9 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1662 microversion: 2.1 time: 0.178329 Jun 29 08:49:21.484888 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 569/1181] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:21 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:22.503382 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-905a2506-6d8d-426a-9ad7-bd607653159a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:22.504218 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-905a2506-6d8d-426a-9ad7-bd607653159a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:22.510986 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-905a2506-6d8d-426a-9ad7-bd607653159a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:22.511741 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-905a2506-6d8d-426a-9ad7-bd607653159a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:22.512636 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-905a2506-6d8d-426a-9ad7-bd607653159a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:22.513156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-905a2506-6d8d-426a-9ad7-bd607653159a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:22.665753 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-905a2506-6d8d-426a-9ad7-bd607653159a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:22.675844 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-905a2506-6d8d-426a-9ad7-bd607653159a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1662 microversion: 2.1 time: 0.177972 Jun 29 08:49:22.676837 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 613/1182] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:22 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:23.694180 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-41199416-2059-4f5e-953a-fc384b365b0a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:23.694807 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-41199416-2059-4f5e-953a-fc384b365b0a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:23.704014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41199416-2059-4f5e-953a-fc384b365b0a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:23.704510 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41199416-2059-4f5e-953a-fc384b365b0a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:23.705646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41199416-2059-4f5e-953a-fc384b365b0a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:23.706098 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-41199416-2059-4f5e-953a-fc384b365b0a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:23.876419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-41199416-2059-4f5e-953a-fc384b365b0a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:23.890208 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-41199416-2059-4f5e-953a-fc384b365b0a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1666 microversion: 2.1 time: 0.199792 Jun 29 08:49:23.902914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 570/1183] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:23 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1666 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:48.983764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-25ad91fe-6f66-4320-957d-a500eb85f249 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:48.985557 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-25ad91fe-6f66-4320-957d-a500eb85f249 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:48.987330 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-003b963a-52fa-4ee9-9a09-9c1178bd1671 req-2791a8b7-07ef-43ae-8a98-aac9d5eaa817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3dd3baa-8bfc-43a2-801d-83e48e7d2291", "tag": "522e353e-263c-429f-b35c-cc2866fded03"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:48.993588 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=15 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:49:48.994245 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:49:48.996071 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25ad91fe-6f66-4320-957d-a500eb85f249 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:48.997863 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25ad91fe-6f66-4320-957d-a500eb85f249 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:48.998003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=13 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:49:48.998003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=16 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:49:48.998192 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25ad91fe-6f66-4320-957d-a500eb85f249 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:48.998192 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25ad91fe-6f66-4320-957d-a500eb85f249 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:48.999866 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-003b963a-52fa-4ee9-9a09-9c1178bd1671 req-2791a8b7-07ef-43ae-8a98-aac9d5eaa817 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:49.000595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-003b963a-52fa-4ee9-9a09-9c1178bd1671 req-2791a8b7-07ef-43ae-8a98-aac9d5eaa817 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:49.015710 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-003b963a-52fa-4ee9-9a09-9c1178bd1671 req-2791a8b7-07ef-43ae-8a98-aac9d5eaa817 service nova] Creating event network-changed:522e353e-263c-429f-b35c-cc2866fded03 for instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 on hv-cinder-79760 Jun 29 08:49:49.023074 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-003b963a-52fa-4ee9-9a09-9c1178bd1671 req-2791a8b7-07ef-43ae-8a98-aac9d5eaa817 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039809 Jun 29 08:49:49.024436 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 571/1184] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:49:49.036691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-25ad91fe-6f66-4320-957d-a500eb85f249 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:49:49.157351 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-25ad91fe-6f66-4320-957d-a500eb85f249 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 204 len: 0 microversion: 2.1 time: 0.178791 Jun 29 08:49:49.158563 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 614/1185] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:49:48 2022] DELETE /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:49:49.167979 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ed2b9179-635f-4573-9a50-c9df6df48e98 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:49.168892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ed2b9179-635f-4573-9a50-c9df6df48e98 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:49.176596 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ed2b9179-635f-4573-9a50-c9df6df48e98 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:49.177074 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ed2b9179-635f-4573-9a50-c9df6df48e98 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:49.178058 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ed2b9179-635f-4573-9a50-c9df6df48e98 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:49.178424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ed2b9179-635f-4573-9a50-c9df6df48e98 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:49.605650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ed2b9179-635f-4573-9a50-c9df6df48e98 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:49.613139 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ed2b9179-635f-4573-9a50-c9df6df48e98 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1576 microversion: 2.1 time: 0.450034 Jun 29 08:49:49.613734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 572/1186] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:49 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1576 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:50.632156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e4c86e71-103f-4a65-ba09-8c7459d8e53d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:50.632855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e4c86e71-103f-4a65-ba09-8c7459d8e53d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:50.642237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4c86e71-103f-4a65-ba09-8c7459d8e53d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:50.642721 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4c86e71-103f-4a65-ba09-8c7459d8e53d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:50.643521 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4c86e71-103f-4a65-ba09-8c7459d8e53d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:50.643958 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4c86e71-103f-4a65-ba09-8c7459d8e53d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:50.786751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e4c86e71-103f-4a65-ba09-8c7459d8e53d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:50.794957 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e4c86e71-103f-4a65-ba09-8c7459d8e53d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1458 microversion: 2.1 time: 0.166997 Jun 29 08:49:50.799053 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 615/1187] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:50 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1458 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:51.813372 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6c708b12-720b-44c4-9a05-3b21a40fcf1d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:51.814107 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6c708b12-720b-44c4-9a05-3b21a40fcf1d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:51.821590 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6c708b12-720b-44c4-9a05-3b21a40fcf1d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:51.822104 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6c708b12-720b-44c4-9a05-3b21a40fcf1d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:51.822967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6c708b12-720b-44c4-9a05-3b21a40fcf1d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:51.823480 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6c708b12-720b-44c4-9a05-3b21a40fcf1d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:52.001916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-6c708b12-720b-44c4-9a05-3b21a40fcf1d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:52.012262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6c708b12-720b-44c4-9a05-3b21a40fcf1d tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 200 len: 1458 microversion: 2.1 time: 0.201526 Jun 29 08:49:52.015774 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 573/1188] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:51 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 1458 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:52.056995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-94ba02ec-421b-4b8c-9d54-c56847ac88cf req-242f4302-b22f-4b94-baf8-936979700de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dd3baa-8bfc-43a2-801d-83e48e7d2291", "name": "network-vif-deleted", "tag": "522e353e-263c-429f-b35c-cc2866fded03"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:52.067606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-94ba02ec-421b-4b8c-9d54-c56847ac88cf req-242f4302-b22f-4b94-baf8-936979700de7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:52.068304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-94ba02ec-421b-4b8c-9d54-c56847ac88cf req-242f4302-b22f-4b94-baf8-936979700de7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:52.080038 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-94ba02ec-421b-4b8c-9d54-c56847ac88cf req-242f4302-b22f-4b94-baf8-936979700de7 service nova] Creating event network-vif-deleted:522e353e-263c-429f-b35c-cc2866fded03 for instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 on hv-cinder-79760 Jun 29 08:49:52.085508 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-94ba02ec-421b-4b8c-9d54-c56847ac88cf req-242f4302-b22f-4b94-baf8-936979700de7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Jun 29 08:49:52.086264 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 616/1189] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:49:53.029959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:53.030609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: b3dd3baa-8bfc-43a2-801d-83e48e7d2291] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:53.037248 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:53.037750 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:53.038523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:53.038977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:53.052914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] HTTP exception thrown: Instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 could not be found. Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Request method failure captured: Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 HTTP/1.1 Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA-75A6968hpQMC_Kzsb8ZZkr6AD2PjEFlEJjtjpJOJgcHd87N2Sbxr10G2crXkbgz2X8FVzaVS88kWHHWetv41ZQ3fWoByNQXs2EpFke5V-xJtKo6rrQyjG-wC9iWaetD0VhK_FAgOL7q2FtOCt1OEJ-NCvKHNjRHDH9SM8t4bl3qs Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:53.054737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa6da3e4a87442299d21f3b55dfe3e9f"}]}] Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 1b2337595cbb40608d6bc485889d8bc6 Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 could not be found. Jun 29 08:49:53.056345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'b3dd3baa-8bfc-43a2-801d-83e48e7d2291'} Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 could not be found. Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:53.057274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 could not be found. Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 could not be found. Jun 29 08:49:53.058755 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:53.060218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Returning 404 to user: Instance b3dd3baa-8bfc-43a2-801d-83e48e7d2291 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:53.060218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7f1366b7-4ad2-4a3e-87f0-8abee0516660 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291" status: 404 len: 111 microversion: 2.1 time: 0.030187 Jun 29 08:49:53.060218 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 574/1190] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:53 2022] GET /compute/v2.1/servers/b3dd3baa-8bfc-43a2-801d-83e48e7d2291 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:56.229021 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b7288f8b-65c6-41cb-a5f2-1bced289ae4f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:56.229743 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b7288f8b-65c6-41cb-a5f2-1bced289ae4f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:56.230058 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-b75538a0-053a-459d-849e-d684c59cf55b req-73206cd2-466f-4712-8419-d64c37d175cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6076488f-0093-4b7c-a6a9-aabd1bc916be", "tag": "81acf11d-e234-4a0d-b1b0-7ac02df25f6d"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:56.236188 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b7288f8b-65c6-41cb-a5f2-1bced289ae4f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:56.236629 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b7288f8b-65c6-41cb-a5f2-1bced289ae4f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:56.237619 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b7288f8b-65c6-41cb-a5f2-1bced289ae4f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:56.238273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b7288f8b-65c6-41cb-a5f2-1bced289ae4f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:56.239232 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-b75538a0-053a-459d-849e-d684c59cf55b req-73206cd2-466f-4712-8419-d64c37d175cd service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:56.239843 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-b75538a0-053a-459d-849e-d684c59cf55b req-73206cd2-466f-4712-8419-d64c37d175cd service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:56.251719 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-b75538a0-053a-459d-849e-d684c59cf55b req-73206cd2-466f-4712-8419-d64c37d175cd service nova] Creating event network-changed:81acf11d-e234-4a0d-b1b0-7ac02df25f6d for instance 6076488f-0093-4b7c-a6a9-aabd1bc916be on hv-cinder-79760 Jun 29 08:49:56.257152 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-b75538a0-053a-459d-849e-d684c59cf55b req-73206cd2-466f-4712-8419-d64c37d175cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031042 Jun 29 08:49:56.257958 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 575/1191] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:49:56.265336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b7288f8b-65c6-41cb-a5f2-1bced289ae4f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:49:56.360663 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b7288f8b-65c6-41cb-a5f2-1bced289ae4f tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 204 len: 0 microversion: 2.1 time: 0.136075 Jun 29 08:49:56.365927 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 617/1192] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:49:56 2022] DELETE /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:49:56.374563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a1ce4b32-557e-4efa-b0a1-6a6a1c68b00c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:56.376791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a1ce4b32-557e-4efa-b0a1-6a6a1c68b00c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:56.383298 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a1ce4b32-557e-4efa-b0a1-6a6a1c68b00c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:56.383738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a1ce4b32-557e-4efa-b0a1-6a6a1c68b00c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:56.384524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a1ce4b32-557e-4efa-b0a1-6a6a1c68b00c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:56.384968 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a1ce4b32-557e-4efa-b0a1-6a6a1c68b00c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:56.515982 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a1ce4b32-557e-4efa-b0a1-6a6a1c68b00c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:56.523936 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a1ce4b32-557e-4efa-b0a1-6a6a1c68b00c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1576 microversion: 2.1 time: 0.156452 Jun 29 08:49:56.524705 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 576/1193] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:56 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:57.542233 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-131d91b9-413c-4ea6-9b33-96bcb9a014d7 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:57.542962 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-131d91b9-413c-4ea6-9b33-96bcb9a014d7 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:57.549771 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-131d91b9-413c-4ea6-9b33-96bcb9a014d7 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:57.550219 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-131d91b9-413c-4ea6-9b33-96bcb9a014d7 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:57.551021 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-131d91b9-413c-4ea6-9b33-96bcb9a014d7 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:57.551638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-131d91b9-413c-4ea6-9b33-96bcb9a014d7 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:57.696149 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-131d91b9-413c-4ea6-9b33-96bcb9a014d7 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2337595cbb40608d6bc485889d8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6da3e4a87442299d21f3b55dfe3e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:49:57.704181 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-131d91b9-413c-4ea6-9b33-96bcb9a014d7 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 200 len: 1458 microversion: 2.1 time: 0.166260 Jun 29 08:49:57.705136 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 618/1194] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:57 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 1458 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:49:58.273412 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-0dd069f5-bc91-4ace-b0f0-04cb13df5b48 req-14aa8ad2-e360-4d2e-8b8f-cb9cf621513e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6076488f-0093-4b7c-a6a9-aabd1bc916be", "name": "network-vif-deleted", "tag": "81acf11d-e234-4a0d-b1b0-7ac02df25f6d"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:49:58.281931 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-0dd069f5-bc91-4ace-b0f0-04cb13df5b48 req-14aa8ad2-e360-4d2e-8b8f-cb9cf621513e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:58.282436 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-0dd069f5-bc91-4ace-b0f0-04cb13df5b48 req-14aa8ad2-e360-4d2e-8b8f-cb9cf621513e service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:58.295641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-0dd069f5-bc91-4ace-b0f0-04cb13df5b48 req-14aa8ad2-e360-4d2e-8b8f-cb9cf621513e service nova] Creating event network-vif-deleted:81acf11d-e234-4a0d-b1b0-7ac02df25f6d for instance 6076488f-0093-4b7c-a6a9-aabd1bc916be on hv-cinder-79760 Jun 29 08:49:58.298999 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-0dd069f5-bc91-4ace-b0f0-04cb13df5b48 req-14aa8ad2-e360-4d2e-8b8f-cb9cf621513e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029507 Jun 29 08:49:58.299544 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 577/1195] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:49:58.725254 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:58.725881 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: 6076488f-0093-4b7c-a6a9-aabd1bc916be] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:58.732803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:58.733244 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:58.733995 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:58.734417 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:58.748129 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] HTTP exception thrown: Instance 6076488f-0093-4b7c-a6a9-aabd1bc916be could not be found. Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Request method failure captured: Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be HTTP/1.1 Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA-75A6968hpQMC_Kzsb8ZZkr6AD2PjEFlEJjtjpJOJgcHd87N2Sbxr10G2crXkbgz2X8FVzaVS88kWHHWetv41ZQ3fWoByNQXs2EpFke5V-xJtKo6rrQyjG-wC9iWaetD0VhK_FAgOL7q2FtOCt1OEJ-NCvKHNjRHDH9SM8t4bl3qs Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:49:58.749785 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa6da3e4a87442299d21f3b55dfe3e9f"}]}] Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 1b2337595cbb40608d6bc485889d8bc6 Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 6076488f-0093-4b7c-a6a9-aabd1bc916be could not be found. Jun 29 08:49:58.751426 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '6076488f-0093-4b7c-a6a9-aabd1bc916be'} Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6076488f-0093-4b7c-a6a9-aabd1bc916be could not be found. Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:58.752201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6076488f-0093-4b7c-a6a9-aabd1bc916be could not be found. Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6076488f-0093-4b7c-a6a9-aabd1bc916be could not be found. Jun 29 08:49:58.753450 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:58.754560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Returning 404 to user: Instance 6076488f-0093-4b7c-a6a9-aabd1bc916be could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:58.754560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-74ffd8cd-182c-43eb-a1d5-2ce7bcf3ddf9 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be" status: 404 len: 111 microversion: 2.1 time: 0.031173 Jun 29 08:49:58.754560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 619/1196] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:58 2022] GET /compute/v2.1/servers/6076488f-0093-4b7c-a6a9-aabd1bc916be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:59.202491 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:59.203102 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:59.210237 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:59.210676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:59.211465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:59.211885 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:59.226186 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] HTTP exception thrown: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Request method failure captured: Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee HTTP/1.1 Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivA-75A6968hpQMC_Kzsb8ZZkr6AD2PjEFlEJjtjpJOJgcHd87N2Sbxr10G2crXkbgz2X8FVzaVS88kWHHWetv41ZQ3fWoByNQXs2EpFke5V-xJtKo6rrQyjG-wC9iWaetD0VhK_FAgOL7q2FtOCt1OEJ-NCvKHNjRHDH9SM8t4bl3qs Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:49:59.227881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa6da3e4a87442299d21f3b55dfe3e9f"}]}] Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 1b2337595cbb40608d6bc485889d8bc6 Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.229280 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'f3d86a45-eb3d-4489-aa2e-c9be196427ee'} Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:59.230096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.231378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.232627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Returning 404 to user: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:59.232627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b05c9072-4581-4fb8-92c6-957b010ccf2c tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 404 len: 111 microversion: 2.1 time: 0.031074 Jun 29 08:49:59.232627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 578/1197] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:49:59 2022] DELETE /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:49:59.238141 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:49:59.238787 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] [instance: f3d86a45-eb3d-4489-aa2e-c9be196427ee] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:49:59.245971 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:59.246424 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:59.247227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:49:59.247663 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:49:59.262109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] HTTP exception thrown: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Request method failure captured: Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee HTTP/1.1 Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivA-75A6968hpQMC_Kzsb8ZZkr6AD2PjEFlEJjtjpJOJgcHd87N2Sbxr10G2crXkbgz2X8FVzaVS88kWHHWetv41ZQ3fWoByNQXs2EpFke5V-xJtKo6rrQyjG-wC9iWaetD0VhK_FAgOL7q2FtOCt1OEJ-NCvKHNjRHDH9SM8t4bl3qs Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:49:59.263675 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa6da3e4a87442299d21f3b55dfe3e9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa6da3e4a87442299d21f3b55dfe3e9f"}]}] Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: fa6da3e4a87442299d21f3b55dfe3e9f Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestVolumeBootPattern-1710614625 Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 1b2337595cbb40608d6bc485889d8bc6 Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestVolumeBootPattern-1710614625-project Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.265086 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'f3d86a45-eb3d-4489-aa2e-c9be196427ee'} Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:49:59.265895 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. Jun 29 08:49:59.267170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:49:59.268295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Returning 404 to user: Instance f3d86a45-eb3d-4489-aa2e-c9be196427ee could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:49:59.268295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-194cfec7-6925-4f4d-ac67-538779d28784 tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee" status: 404 len: 111 microversion: 2.1 time: 0.030896 Jun 29 08:49:59.268295 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 620/1198] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:49:59 2022] GET /compute/v2.1/servers/f3d86a45-eb3d-4489-aa2e-c9be196427ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:50:00.629779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7d7925ae-4568-4669-a899-63790215fd6e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] Calling method '.version_select at 0x7fade4261ca0>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:00.666773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7d7925ae-4568-4669-a899-63790215fd6e tempest-TestVolumeBootPattern-1710614625 tempest-TestVolumeBootPattern-1710614625-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1732324740" status: 202 len: 0 microversion: 2.1 time: 0.040802 Jun 29 08:50:00.672241 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 579/1199] 10.222.0.27 () {58 vars in 1262 bytes} [Wed Jun 29 08:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1732324740 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:50:21.183436 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:50:21.184310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 08:50:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:50:21.485532 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:50:21.486008 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Wed Jun 29 08:50:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:50:22.205177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ce7ee2ee-4748-4082-a68a-6ebd435c26e2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:22.206147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ce7ee2ee-4748-4082-a68a-6ebd435c26e2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:22.208454 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:50:22.209116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:50:22.215720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce7ee2ee-4748-4082-a68a-6ebd435c26e2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:22.216175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce7ee2ee-4748-4082-a68a-6ebd435c26e2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:22.216935 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce7ee2ee-4748-4082-a68a-6ebd435c26e2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:22.217371 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce7ee2ee-4748-4082-a68a-6ebd435c26e2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:22.248850 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ce7ee2ee-4748-4082-a68a-6ebd435c26e2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047788 Jun 29 08:50:22.249405 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 621/1200] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:50:22 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:50:22.306912 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0b39bb4d-bcd6-49ec-8297-18a96b470ba4 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:22.307460 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0b39bb4d-bcd6-49ec-8297-18a96b470ba4 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:22.310311 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=28 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:50:22.310970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:50:22.316976 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0b39bb4d-bcd6-49ec-8297-18a96b470ba4 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:22.317652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0b39bb4d-bcd6-49ec-8297-18a96b470ba4 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:22.318425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0b39bb4d-bcd6-49ec-8297-18a96b470ba4 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:22.318892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0b39bb4d-bcd6-49ec-8297-18a96b470ba4 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:22.345215 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0b39bb4d-bcd6-49ec-8297-18a96b470ba4 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:50:22.441904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0b39bb4d-bcd6-49ec-8297-18a96b470ba4 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 204 len: 0 microversion: 2.1 time: 0.138668 Jun 29 08:50:22.442479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 580/1201] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:50:22 2022] DELETE /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:50:22.451361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-de639aff-1e81-4c9b-af78-8affa280bf48 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:22.451964 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-de639aff-1e81-4c9b-af78-8affa280bf48 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:22.458227 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de639aff-1e81-4c9b-af78-8affa280bf48 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:22.458666 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de639aff-1e81-4c9b-af78-8affa280bf48 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:22.459454 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de639aff-1e81-4c9b-af78-8affa280bf48 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:22.459878 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de639aff-1e81-4c9b-af78-8affa280bf48 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:22.592704 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-de639aff-1e81-4c9b-af78-8affa280bf48 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:22.600400 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-de639aff-1e81-4c9b-af78-8affa280bf48 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1672 microversion: 2.1 time: 0.152965 Jun 29 08:50:22.600960 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 622/1202] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:22 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:23.618289 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-58395901-0089-42fd-b1b1-f6cbffd657d2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:23.619019 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-58395901-0089-42fd-b1b1-f6cbffd657d2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:23.625893 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-58395901-0089-42fd-b1b1-f6cbffd657d2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:23.626337 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-58395901-0089-42fd-b1b1-f6cbffd657d2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:23.627107 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-58395901-0089-42fd-b1b1-f6cbffd657d2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:23.627563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-58395901-0089-42fd-b1b1-f6cbffd657d2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:23.767194 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-58395901-0089-42fd-b1b1-f6cbffd657d2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:23.775439 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-58395901-0089-42fd-b1b1-f6cbffd657d2 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1672 microversion: 2.1 time: 0.161541 Jun 29 08:50:23.776023 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 581/1203] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:23 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:24.799920 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-721f8742-a81e-4766-b03f-ee556e9adc91 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:24.800535 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-721f8742-a81e-4766-b03f-ee556e9adc91 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:24.807605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-721f8742-a81e-4766-b03f-ee556e9adc91 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:24.808025 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-721f8742-a81e-4766-b03f-ee556e9adc91 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:24.808873 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-721f8742-a81e-4766-b03f-ee556e9adc91 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:24.809298 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-721f8742-a81e-4766-b03f-ee556e9adc91 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:24.879954 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-721f8742-a81e-4766-b03f-ee556e9adc91 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:24.897603 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-721f8742-a81e-4766-b03f-ee556e9adc91 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 200 len: 1606 microversion: 2.1 time: 0.101808 Jun 29 08:50:24.907175 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 623/1204] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:24 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 1606 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:24.937041 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-42cc0b85-5aa1-4e99-96c6-a69102fa3f97 req-bd8f0cb3-7e1a-479b-8455-1b7d7da073e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1496b38e-1b75-490e-a93b-cf84acb22ef8", "name": "network-vif-deleted", "tag": "5cdda97a-5352-4a7f-88fa-ab8f047cba1d"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:50:24.945946 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-42cc0b85-5aa1-4e99-96c6-a69102fa3f97 req-bd8f0cb3-7e1a-479b-8455-1b7d7da073e9 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:24.946343 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-42cc0b85-5aa1-4e99-96c6-a69102fa3f97 req-bd8f0cb3-7e1a-479b-8455-1b7d7da073e9 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:24.960187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-42cc0b85-5aa1-4e99-96c6-a69102fa3f97 req-bd8f0cb3-7e1a-479b-8455-1b7d7da073e9 service nova] Creating event network-vif-deleted:5cdda97a-5352-4a7f-88fa-ab8f047cba1d for instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 on hv-cinder-79760 Jun 29 08:50:24.965727 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-42cc0b85-5aa1-4e99-96c6-a69102fa3f97 req-bd8f0cb3-7e1a-479b-8455-1b7d7da073e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Jun 29 08:50:24.966440 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 582/1205] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:50:25.915503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:25.916107 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:25.923184 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:25.923633 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:25.924418 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:25.924859 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:25.940036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] HTTP exception thrown: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Request method failure captured: Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 HTTP/1.1 Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBEFLQj44FNPhH4reyAPpF7Kl8uS3C3pDBSSA4g6za_fsWWiiMqZfrxTvkqzAstvGkMRDfnOyOkmW_lbn4HAH29r6IAMTyDhF7aEByQobf241Hc1NvQxyZz0rckC0Bba2N6JwBuiEG-eXR5NRg7EsJeyZHEEBAOhdGFHuxEr85Dw0Tw Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:50:25.941611 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7faee22e84ba4b8b85f4d4cf6132d83f"}]}] Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 88a1f82bc0924a84849d390f138041a1 Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:50:25.943321 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '1496b38e-1b75-490e-a93b-cf84acb22ef8'} Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:50:25.944488 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:50:25.946124 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:50:25.948554 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Returning 404 to user: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:50:25.948554 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-02382562-f20c-421f-a235-5e84d42b2c1c tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 404 len: 111 microversion: 2.1 time: 0.031748 Jun 29 08:50:25.948554 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 624/1206] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:25 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:50:25.953487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7ea4663b-83fa-4cb3-af55-d034d5385d53 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '.version_select at 0x7fade416a4c0>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:25.982650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7ea4663b-83fa-4cb3-af55-d034d5385d53 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251595214" status: 202 len: 0 microversion: 2.1 time: 0.034019 Jun 29 08:50:25.983259 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 583/1207] 10.222.0.27 () {58 vars in 1220 bytes} [Wed Jun 29 08:50:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251595214 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:50:26.876893 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d25490d1-0e74-42df-807b-bcb9964c4c8b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'create', calling method: .version_select at 0x7fade41981f0>, body: {"keypair": {"name": "tempest-keypair-1883331170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSM3kDpYPEd2tMcpjX03qnxBLQ5dxyCCFPT2E1N76mYJLyTaagYBUUoQgaB13jnx7rV1ges/RTYWK5pPGjOOhUHeitMivhqJ5hvOV09kSH6p+zxVHEh9/ztRRsVTQae1A=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:50:26.891815 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-d25490d1-0e74-42df-807b-bcb9964c4c8b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Getting quotas for project 7faee22e84ba4b8b85f4d4cf6132d83f. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:50:26.895648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-d25490d1-0e74-42df-807b-bcb9964c4c8b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Getting quotas for user 88a1f82bc0924a84849d390f138041a1 and project 7faee22e84ba4b8b85f4d4cf6132d83f. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:50:26.919363 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d25490d1-0e74-42df-807b-bcb9964c4c8b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046410 Jun 29 08:50:26.920060 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 625/1208] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:50:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:50:28.196508 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1682295866", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44eadba2-f1ac-4300-8662-0179b71e9c7e"}], "security_groups": [{"name": "tempest-securitygroup--1792774369"}], "key_name": "tempest-keypair-1883331170", "user_data": "}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:50:28.315038 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] validate_networks() for [('44eadba2-f1ac-4300-8662-0179b71e9c7e', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:50:28.734499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:50:28.735120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:50:28.735810 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:50:28.736392 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:50:28.736996 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:50:28.751127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:28.751746 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:28.752907 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:28.753465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:28.773445 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Getting quotas for project 7faee22e84ba4b8b85f4d4cf6132d83f. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:50:28.777871 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Getting quotas for user 88a1f82bc0924a84849d390f138041a1 and project 7faee22e84ba4b8b85f4d4cf6132d83f. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:50:28.789602 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:50:28.792139 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:50:28.840165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6694481c-3f89-4acb-aaec-964229b9fd93 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647922 Jun 29 08:50:28.840800 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 584/1209] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:50:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:50:28.852212 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-211db8f8-a6ab-4a99-8a44-2211c5ecaec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:28.853268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-211db8f8-a6ab-4a99-8a44-2211c5ecaec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:28.906996 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-211db8f8-a6ab-4a99-8a44-2211c5ecaec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:28.916545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-211db8f8-a6ab-4a99-8a44-2211c5ecaec5 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1238 microversion: 2.1 time: 0.069295 Jun 29 08:50:28.917182 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 626/1210] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:28 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:29.934468 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a447fd2d-df36-452a-a130-939027d48a1b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:29.935048 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a447fd2d-df36-452a-a130-939027d48a1b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:29.942212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a447fd2d-df36-452a-a130-939027d48a1b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:29.942669 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a447fd2d-df36-452a-a130-939027d48a1b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:29.943465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a447fd2d-df36-452a-a130-939027d48a1b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:29.943892 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a447fd2d-df36-452a-a130-939027d48a1b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:30.008137 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a447fd2d-df36-452a-a130-939027d48a1b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:30.015646 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a447fd2d-df36-452a-a130-939027d48a1b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1296 microversion: 2.1 time: 0.085958 Jun 29 08:50:30.016170 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 585/1211] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:29 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:31.035708 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-53485078-f0c2-4844-bfed-63c706438c34 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:31.036378 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-53485078-f0c2-4844-bfed-63c706438c34 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:31.045522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53485078-f0c2-4844-bfed-63c706438c34 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:31.045969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53485078-f0c2-4844-bfed-63c706438c34 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:31.046904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53485078-f0c2-4844-bfed-63c706438c34 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:31.047337 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53485078-f0c2-4844-bfed-63c706438c34 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:31.193773 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-53485078-f0c2-4844-bfed-63c706438c34 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:31.202021 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-53485078-f0c2-4844-bfed-63c706438c34 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1364 microversion: 2.1 time: 0.172552 Jun 29 08:50:31.202969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 627/1212] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:31 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:31.335109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-74ba104b-a5c7-48dc-a464-c14720d5d21f req-1b087e43-80c2-4ae5-a51e-05cf41863e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f", "tag": "52947f50-52dc-468a-aff2-284546555289"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:50:31.347004 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-74ba104b-a5c7-48dc-a464-c14720d5d21f req-1b087e43-80c2-4ae5-a51e-05cf41863e3f service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:31.347437 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-74ba104b-a5c7-48dc-a464-c14720d5d21f req-1b087e43-80c2-4ae5-a51e-05cf41863e3f service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:31.372910 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-74ba104b-a5c7-48dc-a464-c14720d5d21f req-1b087e43-80c2-4ae5-a51e-05cf41863e3f service nova] Creating event network-changed:52947f50-52dc-468a-aff2-284546555289 for instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f on hv-cinder-79760 Jun 29 08:50:31.379733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-74ba104b-a5c7-48dc-a464-c14720d5d21f req-1b087e43-80c2-4ae5-a51e-05cf41863e3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050024 Jun 29 08:50:31.380903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 586/1213] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:50:32.222221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2f010f82-438d-4a87-ac8c-d4a27505cf11 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:32.223118 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2f010f82-438d-4a87-ac8c-d4a27505cf11 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:32.232104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2f010f82-438d-4a87-ac8c-d4a27505cf11 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:32.232694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2f010f82-438d-4a87-ac8c-d4a27505cf11 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:32.233708 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2f010f82-438d-4a87-ac8c-d4a27505cf11 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:32.234279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2f010f82-438d-4a87-ac8c-d4a27505cf11 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:32.371794 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2f010f82-438d-4a87-ac8c-d4a27505cf11 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:32.379630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2f010f82-438d-4a87-ac8c-d4a27505cf11 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1364 microversion: 2.1 time: 0.162705 Jun 29 08:50:32.380190 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 628/1214] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:32 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:33.398684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0179bafc-d781-419b-85fc-61b3ad52b3ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:33.399427 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0179bafc-d781-419b-85fc-61b3ad52b3ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:33.406543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0179bafc-d781-419b-85fc-61b3ad52b3ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:33.407007 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0179bafc-d781-419b-85fc-61b3ad52b3ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:33.407759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0179bafc-d781-419b-85fc-61b3ad52b3ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:33.408178 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0179bafc-d781-419b-85fc-61b3ad52b3ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:33.543273 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0179bafc-d781-419b-85fc-61b3ad52b3ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:33.551016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0179bafc-d781-419b-85fc-61b3ad52b3ff tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1364 microversion: 2.1 time: 0.156548 Jun 29 08:50:33.551576 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 587/1215] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:33 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:34.568855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0a9b2c48-e143-4e81-ad40-7019ffe21d30 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:34.570156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0a9b2c48-e143-4e81-ad40-7019ffe21d30 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:34.577346 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a9b2c48-e143-4e81-ad40-7019ffe21d30 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:34.577801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a9b2c48-e143-4e81-ad40-7019ffe21d30 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:34.578573 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a9b2c48-e143-4e81-ad40-7019ffe21d30 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:34.579042 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a9b2c48-e143-4e81-ad40-7019ffe21d30 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:34.722759 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0a9b2c48-e143-4e81-ad40-7019ffe21d30 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:34.730355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0a9b2c48-e143-4e81-ad40-7019ffe21d30 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1364 microversion: 2.1 time: 0.165509 Jun 29 08:50:34.730928 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 629/1216] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:34 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:35.750975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e043635b-fcad-4a31-a9bb-0a96f9ba5097 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:35.751613 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e043635b-fcad-4a31-a9bb-0a96f9ba5097 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:35.759635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e043635b-fcad-4a31-a9bb-0a96f9ba5097 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:35.760155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e043635b-fcad-4a31-a9bb-0a96f9ba5097 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:35.761445 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e043635b-fcad-4a31-a9bb-0a96f9ba5097 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:35.761977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e043635b-fcad-4a31-a9bb-0a96f9ba5097 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:35.900749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-e043635b-fcad-4a31-a9bb-0a96f9ba5097 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:35.908894 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e043635b-fcad-4a31-a9bb-0a96f9ba5097 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1364 microversion: 2.1 time: 0.163852 Jun 29 08:50:35.909477 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 588/1217] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:35 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:36.871194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-5d4a3d59-833b-42d1-b507-be141ccbe373 req-539063df-3ce4-4f65-a29f-34622507de5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f", "name": "network-vif-plugged", "status": "completed", "tag": "52947f50-52dc-468a-aff2-284546555289"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:50:36.880925 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-5d4a3d59-833b-42d1-b507-be141ccbe373 req-539063df-3ce4-4f65-a29f-34622507de5d service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:36.881376 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-5d4a3d59-833b-42d1-b507-be141ccbe373 req-539063df-3ce4-4f65-a29f-34622507de5d service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:36.894595 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-5d4a3d59-833b-42d1-b507-be141ccbe373 req-539063df-3ce4-4f65-a29f-34622507de5d service nova] Creating event network-vif-plugged:52947f50-52dc-468a-aff2-284546555289 for instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f on hv-cinder-79760 Jun 29 08:50:36.899621 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-5d4a3d59-833b-42d1-b507-be141ccbe373 req-539063df-3ce4-4f65-a29f-34622507de5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 Jun 29 08:50:36.900213 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 630/1218] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:50:36.925472 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-343478b0-5a37-4947-b812-e02ab851c929 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:36.926085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-343478b0-5a37-4947-b812-e02ab851c929 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:36.933296 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-343478b0-5a37-4947-b812-e02ab851c929 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:36.933756 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-343478b0-5a37-4947-b812-e02ab851c929 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:36.934534 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-343478b0-5a37-4947-b812-e02ab851c929 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:36.934994 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-343478b0-5a37-4947-b812-e02ab851c929 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:37.072348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-343478b0-5a37-4947-b812-e02ab851c929 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:37.080262 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-343478b0-5a37-4947-b812-e02ab851c929 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1364 microversion: 2.1 time: 0.158612 Jun 29 08:50:37.080835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 589/1219] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:36 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:38.098758 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b345c67e-7b68-48e5-87ac-64bbda54911b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:38.099455 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b345c67e-7b68-48e5-87ac-64bbda54911b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:38.110071 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b345c67e-7b68-48e5-87ac-64bbda54911b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:38.110612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b345c67e-7b68-48e5-87ac-64bbda54911b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:38.111490 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b345c67e-7b68-48e5-87ac-64bbda54911b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:38.111939 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b345c67e-7b68-48e5-87ac-64bbda54911b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:38.260236 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b345c67e-7b68-48e5-87ac-64bbda54911b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:38.267938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b345c67e-7b68-48e5-87ac-64bbda54911b tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1364 microversion: 2.1 time: 0.173978 Jun 29 08:50:38.268545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 631/1220] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:38 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:39.289349 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-14f10f06-cab8-48d7-94fd-be4c61ebe727 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:39.290260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-14f10f06-cab8-48d7-94fd-be4c61ebe727 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:39.294015 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:50:39.294525 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:50:39.301251 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-14f10f06-cab8-48d7-94fd-be4c61ebe727 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:39.301627 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-14f10f06-cab8-48d7-94fd-be4c61ebe727 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:39.302383 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-14f10f06-cab8-48d7-94fd-be4c61ebe727 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:39.302846 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-14f10f06-cab8-48d7-94fd-be4c61ebe727 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:39.440281 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-14f10f06-cab8-48d7-94fd-be4c61ebe727 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:50:39.448111 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-14f10f06-cab8-48d7-94fd-be4c61ebe727 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1550 microversion: 2.1 time: 0.165319 Jun 29 08:50:39.448644 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 590/1221] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:50:39 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:50:39.465150 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7298a4f2-2ca1-4c54-8944-371ad9b7a117 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:50:39.465672 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7298a4f2-2ca1-4c54-8944-371ad9b7a117 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:50:39.467876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:50:39.473409 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7298a4f2-2ca1-4c54-8944-371ad9b7a117 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:39.473827 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7298a4f2-2ca1-4c54-8944-371ad9b7a117 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:39.474620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7298a4f2-2ca1-4c54-8944-371ad9b7a117 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:39.475080 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7298a4f2-2ca1-4c54-8944-371ad9b7a117 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:39.564292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7298a4f2-2ca1-4c54-8944-371ad9b7a117 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103150 Jun 29 08:50:39.565166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 632/1222] 10.222.0.27 () {58 vars in 1274 bytes} [Wed Jun 29 08:50:39 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:50:40.529861 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-f258b5be-7f7a-489b-a830-c27a4aa366fb req-ab9017aa-fef3-402a-a387-37cd72ba76c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f", "tag": "52947f50-52dc-468a-aff2-284546555289"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:50:40.538496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f258b5be-7f7a-489b-a830-c27a4aa366fb req-ab9017aa-fef3-402a-a387-37cd72ba76c9 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:50:40.538968 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f258b5be-7f7a-489b-a830-c27a4aa366fb req-ab9017aa-fef3-402a-a387-37cd72ba76c9 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:50:40.550749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-f258b5be-7f7a-489b-a830-c27a4aa366fb req-ab9017aa-fef3-402a-a387-37cd72ba76c9 service nova] Creating event network-changed:52947f50-52dc-468a-aff2-284546555289 for instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f on hv-cinder-79760 Jun 29 08:50:40.555830 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-f258b5be-7f7a-489b-a830-c27a4aa366fb req-ab9017aa-fef3-402a-a387-37cd72ba76c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030476 Jun 29 08:50:40.556412 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 591/1223] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:51:55.445286 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:51:55.446087 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=50 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:51:55.452655 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e9669ffb-8968-466a-94c4-7ac54dea0819 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:51:55.453445 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e9669ffb-8968-466a-94c4-7ac54dea0819 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:51:55.465594 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9669ffb-8968-466a-94c4-7ac54dea0819 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:51:55.466313 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9669ffb-8968-466a-94c4-7ac54dea0819 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:51:55.467604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9669ffb-8968-466a-94c4-7ac54dea0819 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:51:55.468304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e9669ffb-8968-466a-94c4-7ac54dea0819 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:51:55.496800 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e9669ffb-8968-466a-94c4-7ac54dea0819 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/ips" status: 200 len: 146 microversion: 2.1 time: 0.053448 Jun 29 08:51:55.497371 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 633/1224] 10.222.0.27 () {58 vars in 1247 bytes} [Wed Jun 29 08:51:55 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:51:56.831511 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:51:56.832255 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:51:56.837457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8f3f4e13-b4e9-436b-ae89-ae9ed96733b8 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd11ce34-9345-4429-b551-b189e1b7e528"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:51:56.838990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8f3f4e13-b4e9-436b-ae89-ae9ed96733b8 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:51:56.847661 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f3f4e13-b4e9-436b-ae89-ae9ed96733b8 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:51:56.848106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f3f4e13-b4e9-436b-ae89-ae9ed96733b8 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:51:56.848865 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f3f4e13-b4e9-436b-ae89-ae9ed96733b8 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:51:56.849311 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f3f4e13-b4e9-436b-ae89-ae9ed96733b8 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:51:57.278146 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8f3f4e13-b4e9-436b-ae89-ae9ed96733b8 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449876 Jun 29 08:51:57.278788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 592/1225] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:51:56 2022] POST /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:52:04.810820 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fa844b6e-442a-489c-a25a-f5d85db40787 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:04.811749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fa844b6e-442a-489c-a25a-f5d85db40787 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:04.819109 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa844b6e-442a-489c-a25a-f5d85db40787 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:04.819547 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa844b6e-442a-489c-a25a-f5d85db40787 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:04.820311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa844b6e-442a-489c-a25a-f5d85db40787 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:04.820735 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa844b6e-442a-489c-a25a-f5d85db40787 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:04.851740 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fa844b6e-442a-489c-a25a-f5d85db40787 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Jun 29 08:52:04.852274 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 634/1226] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:52:04 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:52:04.865637 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8477a877-2513-4e9d-8580-bbf38ebe8945 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:04.866216 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8477a877-2513-4e9d-8580-bbf38ebe8945 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:04.873398 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8477a877-2513-4e9d-8580-bbf38ebe8945 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:04.873840 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8477a877-2513-4e9d-8580-bbf38ebe8945 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:04.874597 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8477a877-2513-4e9d-8580-bbf38ebe8945 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:04.875057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8477a877-2513-4e9d-8580-bbf38ebe8945 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:04.904844 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8477a877-2513-4e9d-8580-bbf38ebe8945 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/cd11ce34-9345-4429-b551-b189e1b7e528" status: 200 len: 194 microversion: 2.1 time: 0.045699 Jun 29 08:52:04.905418 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 593/1227] 10.222.0.27 () {58 vars in 1412 bytes} [Wed Jun 29 08:52:04 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/cd11ce34-9345-4429-b551-b189e1b7e528 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:52:06.241113 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec0fabee-5d68-4dbe-ade5-e5b3a43e12cf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "338703c0-c52a-4d0d-9f4f-72effd63631d"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:52:06.242182 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec0fabee-5d68-4dbe-ade5-e5b3a43e12cf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:06.249259 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec0fabee-5d68-4dbe-ade5-e5b3a43e12cf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:06.249707 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec0fabee-5d68-4dbe-ade5-e5b3a43e12cf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:06.250500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec0fabee-5d68-4dbe-ade5-e5b3a43e12cf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:06.250947 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec0fabee-5d68-4dbe-ade5-e5b3a43e12cf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:06.578630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec0fabee-5d68-4dbe-ade5-e5b3a43e12cf tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "POST /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343152 Jun 29 08:52:06.579268 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 635/1228] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:52:06 2022] POST /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:52:14.124872 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-8f5c6c20-5080-47c0-98ce-af93aacf4722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:14.125886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-8f5c6c20-5080-47c0-98ce-af93aacf4722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:14.132943 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f5c6c20-5080-47c0-98ce-af93aacf4722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:14.133353 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f5c6c20-5080-47c0-98ce-af93aacf4722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:14.134123 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f5c6c20-5080-47c0-98ce-af93aacf4722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:14.134545 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-8f5c6c20-5080-47c0-98ce-af93aacf4722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:14.163767 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-8f5c6c20-5080-47c0-98ce-af93aacf4722 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042942 Jun 29 08:52:14.164315 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 594/1229] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:52:14 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:52:14.307949 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ad7548c7-82a4-4a12-8a19-6b2c5c4573fa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:14.308564 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ad7548c7-82a4-4a12-8a19-6b2c5c4573fa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:14.315627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad7548c7-82a4-4a12-8a19-6b2c5c4573fa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:14.316065 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad7548c7-82a4-4a12-8a19-6b2c5c4573fa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:14.316813 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad7548c7-82a4-4a12-8a19-6b2c5c4573fa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:14.317240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad7548c7-82a4-4a12-8a19-6b2c5c4573fa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:14.346350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ad7548c7-82a4-4a12-8a19-6b2c5c4573fa tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/cd11ce34-9345-4429-b551-b189e1b7e528" status: 200 len: 194 microversion: 2.1 time: 0.043268 Jun 29 08:52:14.346864 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 636/1230] 10.222.0.27 () {58 vars in 1412 bytes} [Wed Jun 29 08:52:14 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/cd11ce34-9345-4429-b551-b189e1b7e528 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:52:14.356970 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-e5cbf573-6833-45b1-8ebc-4bee85b87c8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:14.357454 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-e5cbf573-6833-45b1-8ebc-4bee85b87c8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:14.363693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e5cbf573-6833-45b1-8ebc-4bee85b87c8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:14.364125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e5cbf573-6833-45b1-8ebc-4bee85b87c8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:14.364866 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e5cbf573-6833-45b1-8ebc-4bee85b87c8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:14.365285 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-e5cbf573-6833-45b1-8ebc-4bee85b87c8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:14.448177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-e5cbf573-6833-45b1-8ebc-4bee85b87c8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lazy-loading 'services' on Instance uuid b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:52:14.528763 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-e5cbf573-6833-45b1-8ebc-4bee85b87c8a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/cd11ce34-9345-4429-b551-b189e1b7e528" status: 202 len: 0 microversion: 2.1 time: 0.175260 Jun 29 08:52:14.529912 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 595/1231] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:52:14 2022] DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/cd11ce34-9345-4429-b551-b189e1b7e528 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:52:16.702019 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b04193a5-ae55-4dba-89cb-e8a238c863be tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:16.702586 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b04193a5-ae55-4dba-89cb-e8a238c863be tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:16.709506 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b04193a5-ae55-4dba-89cb-e8a238c863be tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:16.710160 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b04193a5-ae55-4dba-89cb-e8a238c863be tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:16.710971 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b04193a5-ae55-4dba-89cb-e8a238c863be tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:16.711400 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b04193a5-ae55-4dba-89cb-e8a238c863be tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:16.740029 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b04193a5-ae55-4dba-89cb-e8a238c863be tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/338703c0-c52a-4d0d-9f4f-72effd63631d" status: 200 len: 194 microversion: 2.1 time: 0.042008 Jun 29 08:52:16.740605 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 637/1232] 10.222.0.27 () {58 vars in 1412 bytes} [Wed Jun 29 08:52:16 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/338703c0-c52a-4d0d-9f4f-72effd63631d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:52:16.755210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cf807be3-d02e-4932-b2e4-15f0f76de3ca tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:16.755815 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cf807be3-d02e-4932-b2e4-15f0f76de3ca tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:16.765399 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf807be3-d02e-4932-b2e4-15f0f76de3ca tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:16.766089 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf807be3-d02e-4932-b2e4-15f0f76de3ca tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:16.767361 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf807be3-d02e-4932-b2e4-15f0f76de3ca tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:16.768061 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf807be3-d02e-4932-b2e4-15f0f76de3ca tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:16.850521 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.objects.instance [None req-cf807be3-d02e-4932-b2e4-15f0f76de3ca tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lazy-loading 'services' on Instance uuid b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f {{(pid=124265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:52:16.925969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cf807be3-d02e-4932-b2e4-15f0f76de3ca tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/338703c0-c52a-4d0d-9f4f-72effd63631d" status: 202 len: 0 microversion: 2.1 time: 0.178296 Jun 29 08:52:16.926547 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 596/1233] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:52:16 2022] DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments/338703c0-c52a-4d0d-9f4f-72effd63631d => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:52:18.122956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0ed8819c-a565-4a4d-91af-65ebf5c75fa0 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:18.123899 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0ed8819c-a565-4a4d-91af-65ebf5c75fa0 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:18.131273 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ed8819c-a565-4a4d-91af-65ebf5c75fa0 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:18.131725 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ed8819c-a565-4a4d-91af-65ebf5c75fa0 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:18.132493 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ed8819c-a565-4a4d-91af-65ebf5c75fa0 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:18.132924 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ed8819c-a565-4a4d-91af-65ebf5c75fa0 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:18.175887 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0ed8819c-a565-4a4d-91af-65ebf5c75fa0 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057822 Jun 29 08:52:18.176959 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 638/1234] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:52:18 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:52:18.310460 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-43199d0d-d541-4279-9ab0-9eddfec3b4c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:18.316424 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-43199d0d-d541-4279-9ab0-9eddfec3b4c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:18.323022 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-43199d0d-d541-4279-9ab0-9eddfec3b4c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:18.323473 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-43199d0d-d541-4279-9ab0-9eddfec3b4c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:18.325487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-43199d0d-d541-4279-9ab0-9eddfec3b4c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:18.325917 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-43199d0d-d541-4279-9ab0-9eddfec3b4c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:18.357312 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-43199d0d-d541-4279-9ab0-9eddfec3b4c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052037 Jun 29 08:52:18.358136 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 597/1235] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:52:18 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:52:18.429234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2d6b2962-a64f-4c3f-82ed-0a15a89bbe0d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:18.429727 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2d6b2962-a64f-4c3f-82ed-0a15a89bbe0d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:18.437190 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d6b2962-a64f-4c3f-82ed-0a15a89bbe0d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:18.437960 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d6b2962-a64f-4c3f-82ed-0a15a89bbe0d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:18.439177 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d6b2962-a64f-4c3f-82ed-0a15a89bbe0d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:18.439606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d6b2962-a64f-4c3f-82ed-0a15a89bbe0d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:18.474036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2d6b2962-a64f-4c3f-82ed-0a15a89bbe0d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:52:18.589327 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2d6b2962-a64f-4c3f-82ed-0a15a89bbe0d tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 204 len: 0 microversion: 2.1 time: 0.163525 Jun 29 08:52:18.590325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 639/1236] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:52:18 2022] DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:52:18.598903 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-959459d0-9a1b-4eb3-ac04-59bf21eae27a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:18.599513 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-959459d0-9a1b-4eb3-ac04-59bf21eae27a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:18.605730 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-959459d0-9a1b-4eb3-ac04-59bf21eae27a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:18.606106 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-959459d0-9a1b-4eb3-ac04-59bf21eae27a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:18.606895 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-959459d0-9a1b-4eb3-ac04-59bf21eae27a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:18.607321 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-959459d0-9a1b-4eb3-ac04-59bf21eae27a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:18.784605 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-959459d0-9a1b-4eb3-ac04-59bf21eae27a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:52:18.796667 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-959459d0-9a1b-4eb3-ac04-59bf21eae27a tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1675 microversion: 2.1 time: 0.201272 Jun 29 08:52:18.797341 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 598/1237] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:52:18 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:52:19.822893 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e14d06ea-6ed9-4639-b3c2-63159d0d2a2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:19.823894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e14d06ea-6ed9-4639-b3c2-63159d0d2a2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:19.834960 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e14d06ea-6ed9-4639-b3c2-63159d0d2a2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:19.835699 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e14d06ea-6ed9-4639-b3c2-63159d0d2a2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:19.836940 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e14d06ea-6ed9-4639-b3c2-63159d0d2a2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:19.837648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e14d06ea-6ed9-4639-b3c2-63159d0d2a2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:19.980304 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e14d06ea-6ed9-4639-b3c2-63159d0d2a2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:52:19.992757 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e14d06ea-6ed9-4639-b3c2-63159d0d2a2f tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1675 microversion: 2.1 time: 0.176919 Jun 29 08:52:19.993572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 640/1238] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:52:19 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:52:21.011273 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-cf6e5f14-20b2-43b7-8a7e-69ca47e235c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:21.012010 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-cf6e5f14-20b2-43b7-8a7e-69ca47e235c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:21.019539 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf6e5f14-20b2-43b7-8a7e-69ca47e235c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:21.020083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf6e5f14-20b2-43b7-8a7e-69ca47e235c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:21.021264 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf6e5f14-20b2-43b7-8a7e-69ca47e235c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:21.021838 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-cf6e5f14-20b2-43b7-8a7e-69ca47e235c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:21.160635 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-cf6e5f14-20b2-43b7-8a7e-69ca47e235c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a1f82bc0924a84849d390f138041a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7faee22e84ba4b8b85f4d4cf6132d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:52:21.168147 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-cf6e5f14-20b2-43b7-8a7e-69ca47e235c6 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 200 len: 1675 microversion: 2.1 time: 0.160900 Jun 29 08:52:21.168741 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 599/1239] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:52:21 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:52:21.552298 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-9e29ad5a-0376-4a7e-a717-1db87bcecf2b req-e6ef7a0f-6af4-46d0-98cf-6243cd27cf48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f", "name": "network-vif-deleted", "tag": "52947f50-52dc-468a-aff2-284546555289"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:52:21.562390 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-9e29ad5a-0376-4a7e-a717-1db87bcecf2b req-e6ef7a0f-6af4-46d0-98cf-6243cd27cf48 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:21.563263 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-9e29ad5a-0376-4a7e-a717-1db87bcecf2b req-e6ef7a0f-6af4-46d0-98cf-6243cd27cf48 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:21.579291 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-9e29ad5a-0376-4a7e-a717-1db87bcecf2b req-e6ef7a0f-6af4-46d0-98cf-6243cd27cf48 service nova] Creating event network-vif-deleted:52947f50-52dc-468a-aff2-284546555289 for instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f on hv-cinder-79760 Jun 29 08:52:21.587339 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-9e29ad5a-0376-4a7e-a717-1db87bcecf2b req-e6ef7a0f-6af4-46d0-98cf-6243cd27cf48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115744 Jun 29 08:52:21.588639 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 641/1240] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:52:22.185235 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:22.185829 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:22.192760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:22.193201 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:22.194142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:22.194563 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:22.209179 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] HTTP exception thrown: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Request method failure captured: Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f HTTP/1.1 Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivBEFLQj44FNPhH4reyAPpF7Kl8uS3C3pDBSSA4g6za_fsWWiiMqZfrxTvkqzAstvGkMRDfnOyOkmW_lbn4HAH29r6IAMTyDhF7aEByQobf241Hc1NvQxyZz0rckC0Bba2N6JwBuiEG-eXR5NRg7EsJeyZHEEBAOhdGFHuxEr85Dw0Tw Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:52:22.210933 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7faee22e84ba4b8b85f4d4cf6132d83f"}]}] Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 88a1f82bc0924a84849d390f138041a1 Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:22.212512 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f'} Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:52:22.213716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:22.215213 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:22.216419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Returning 404 to user: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:52:22.216419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-1f2a50fb-8612-4105-81f0-ca18e672a534 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 404 len: 111 microversion: 2.1 time: 0.031237 Jun 29 08:52:22.216419 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 600/1241] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:52:22 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:52:22.222591 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6914c078-7c45-4d0b-b75f-8d14da149dde tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '.version_select at 0x7fade4223dc0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:22.242170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6914c078-7c45-4d0b-b75f-8d14da149dde tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883331170" status: 202 len: 0 microversion: 2.1 time: 0.023778 Jun 29 08:52:22.242788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 642/1242] 10.222.0.27 () {58 vars in 1220 bytes} [Wed Jun 29 08:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883331170 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:52:25.150716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:25.151260 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:25.157835 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:25.158274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:25.159165 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:25.159633 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:25.174123 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] HTTP exception thrown: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Request method failure captured: Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f HTTP/1.1 Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivBEFLQj44FNPhH4reyAPpF7Kl8uS3C3pDBSSA4g6za_fsWWiiMqZfrxTvkqzAstvGkMRDfnOyOkmW_lbn4HAH29r6IAMTyDhF7aEByQobf241Hc1NvQxyZz0rckC0Bba2N6JwBuiEG-eXR5NRg7EsJeyZHEEBAOhdGFHuxEr85Dw0Tw Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:52:25.175802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7faee22e84ba4b8b85f4d4cf6132d83f"}]}] Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 88a1f82bc0924a84849d390f138041a1 Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.177543 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': 'b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f'} Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:52:25.178489 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.180083 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.181684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Returning 404 to user: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:52:25.181684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4b6ecfc9-0045-4145-9718-84bdc2315c07 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 404 len: 111 microversion: 2.1 time: 0.030711 Jun 29 08:52:25.181684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 601/1243] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:52:25 2022] DELETE /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:52:25.187048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:25.187774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:25.194155 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:25.194592 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:25.195409 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:25.195968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:25.212358 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] HTTP exception thrown: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Request method failure captured: Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f HTTP/1.1 Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBEFLQj44FNPhH4reyAPpF7Kl8uS3C3pDBSSA4g6za_fsWWiiMqZfrxTvkqzAstvGkMRDfnOyOkmW_lbn4HAH29r6IAMTyDhF7aEByQobf241Hc1NvQxyZz0rckC0Bba2N6JwBuiEG-eXR5NRg7EsJeyZHEEBAOhdGFHuxEr85Dw0Tw Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:52:25.215938 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7faee22e84ba4b8b85f4d4cf6132d83f"}]}] Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 88a1f82bc0924a84849d390f138041a1 Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.217487 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f'} Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:52:25.218361 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. Jun 29 08:52:25.219691 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:25.220806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Returning 404 to user: Instance b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:52:25.220806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3241e62b-aab2-4b2a-a8e5-77613f07b4ed tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f" status: 404 len: 111 microversion: 2.1 time: 0.034978 Jun 29 08:52:25.220806 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 643/1244] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:52:25 2022] GET /compute/v2.1/servers/b4b7e1db-afc4-4e1c-a25f-a6e9f9a7289f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:52:26.359934 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:26.360530 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:26.367678 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:26.368121 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:26.368885 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:26.369308 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:26.385016 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] HTTP exception thrown: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Request method failure captured: Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: DELETE /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 HTTP/1.1 Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivBEFLQj44FNPhH4reyAPpF7Kl8uS3C3pDBSSA4g6za_fsWWiiMqZfrxTvkqzAstvGkMRDfnOyOkmW_lbn4HAH29r6IAMTyDhF7aEByQobf241Hc1NvQxyZz0rckC0Bba2N6JwBuiEG-eXR5NRg7EsJeyZHEEBAOhdGFHuxEr85Dw0Tw Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:52:26.386535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7faee22e84ba4b8b85f4d4cf6132d83f"}]}] Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 88a1f82bc0924a84849d390f138041a1 Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.388169 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '1496b38e-1b75-490e-a93b-cf84acb22ef8'} Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:52:26.389140 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.390499 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.391791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Returning 404 to user: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:52:26.391791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-52ef8ba4-806e-4dae-a69b-5deb266049e1 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 404 len: 111 microversion: 2.1 time: 0.032735 Jun 29 08:52:26.391791 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 602/1245] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:52:26 2022] DELETE /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:52:26.397975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:52:26.398570 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] [instance: 1496b38e-1b75-490e-a93b-cf84acb22ef8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:52:26.401074 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:52:26.409066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:26.409531 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:26.410667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:52:26.411126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:52:26.415105 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:52:26.430114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] HTTP exception thrown: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Request method failure captured: Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 HTTP/1.1 Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBEFLQj44FNPhH4reyAPpF7Kl8uS3C3pDBSSA4g6za_fsWWiiMqZfrxTvkqzAstvGkMRDfnOyOkmW_lbn4HAH29r6IAMTyDhF7aEByQobf241Hc1NvQxyZz0rckC0Bba2N6JwBuiEG-eXR5NRg7EsJeyZHEEBAOhdGFHuxEr85Dw0Tw Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:52:26.431804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7faee22e84ba4b8b85f4d4cf6132d83f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7faee22e84ba4b8b85f4d4cf6132d83f"}]}] Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 7faee22e84ba4b8b85f4d4cf6132d83f Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719429277 Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 88a1f82bc0924a84849d390f138041a1 Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeTestJSON-1719429277-project Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.433325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': '1496b38e-1b75-490e-a93b-cf84acb22ef8'} Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:52:26.435044 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. Jun 29 08:52:26.436476 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:52:26.437643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] Returning 404 to user: Instance 1496b38e-1b75-490e-a93b-cf84acb22ef8 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:52:26.437643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2d6cb4fe-00b9-4c1a-a7f9-8d20f7c83426 tempest-AttachVolumeTestJSON-1719429277 tempest-AttachVolumeTestJSON-1719429277-project] 10.222.0.27 "GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8" status: 404 len: 111 microversion: 2.1 time: 0.039232 Jun 29 08:52:26.437643 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 644/1246] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:52:26 2022] GET /compute/v2.1/servers/1496b38e-1b75-490e-a93b-cf84acb22ef8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:53:15.490808 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1657815461", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "networks": [{"uuid": "83feb3a3-f15e-4205-88ed-cea7ef36493b"}]}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:53:15.498594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=22 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:15.499274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:15.547252 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] validate_networks() for [('83feb3a3-f15e-4205-88ed-cea7ef36493b', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:53:15.958856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:53:15.959289 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:53:15.959760 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:53:15.960181 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:53:15.962535 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:53:15.972594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:15.973044 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:15.973840 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:15.974273 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:15.991536 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Getting quotas for project 37185eb6b2dd4375a6909aaefe1cc7f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:53:15.995759 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Getting quotas for user 3ed513efcdf04cc48abcb078e857c025 and project 37185eb6b2dd4375a6909aaefe1cc7f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:53:16.008925 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:53:16.011201 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:53:16.068124 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b02cc996-118f-4e83-bee2-5ed078c4e7c1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581162 Jun 29 08:53:16.068753 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 603/1247] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:53:16.078968 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1a35e61f-8d08-41da-8396-ab5845721e36 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:16.079764 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1a35e61f-8d08-41da-8396-ab5845721e36 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:16.082435 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:16.143296 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1a35e61f-8d08-41da-8396-ab5845721e36 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:16.149918 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1a35e61f-8d08-41da-8396-ab5845721e36 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1214 microversion: 2.1 time: 0.074934 Jun 29 08:53:16.150485 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 645/1248] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:16 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:17.171045 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-87729484-3619-4c9a-a038-8f68693f0e80 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:17.171665 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-87729484-3619-4c9a-a038-8f68693f0e80 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:17.178524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-87729484-3619-4c9a-a038-8f68693f0e80 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:17.179085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-87729484-3619-4c9a-a038-8f68693f0e80 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:17.179865 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-87729484-3619-4c9a-a038-8f68693f0e80 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:17.180349 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-87729484-3619-4c9a-a038-8f68693f0e80 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:17.256388 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-87729484-3619-4c9a-a038-8f68693f0e80 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:17.264194 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-87729484-3619-4c9a-a038-8f68693f0e80 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1274 microversion: 2.1 time: 0.099825 Jun 29 08:53:17.265126 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 604/1249] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:17 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:18.283332 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b12c6dc0-f5b3-4612-8a05-e9147a690690 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:18.283927 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b12c6dc0-f5b3-4612-8a05-e9147a690690 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:18.291235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b12c6dc0-f5b3-4612-8a05-e9147a690690 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:18.291604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b12c6dc0-f5b3-4612-8a05-e9147a690690 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:18.292370 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b12c6dc0-f5b3-4612-8a05-e9147a690690 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:18.292799 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b12c6dc0-f5b3-4612-8a05-e9147a690690 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:18.424990 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b12c6dc0-f5b3-4612-8a05-e9147a690690 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:18.433048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b12c6dc0-f5b3-4612-8a05-e9147a690690 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1314 microversion: 2.1 time: 0.153711 Jun 29 08:53:18.433620 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 646/1250] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:18 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:18.682116 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-b240279f-10c1-41a5-b968-83ea61b78093 req-e1297fa4-9a33-4ce6-8ee9-8e4e8c1872ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a631b9-92fc-4034-82c8-fd2322d2ecfb", "tag": "a82e4219-d279-4a96-a7d9-ca2c715acfd0"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:53:18.691620 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-b240279f-10c1-41a5-b968-83ea61b78093 req-e1297fa4-9a33-4ce6-8ee9-8e4e8c1872ed service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:18.692405 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-b240279f-10c1-41a5-b968-83ea61b78093 req-e1297fa4-9a33-4ce6-8ee9-8e4e8c1872ed service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:18.703945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-b240279f-10c1-41a5-b968-83ea61b78093 req-e1297fa4-9a33-4ce6-8ee9-8e4e8c1872ed service nova] Creating event network-changed:a82e4219-d279-4a96-a7d9-ca2c715acfd0 for instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb on hv-cinder-79760 Jun 29 08:53:18.708826 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-b240279f-10c1-41a5-b968-83ea61b78093 req-e1297fa4-9a33-4ce6-8ee9-8e4e8c1872ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030862 Jun 29 08:53:18.709457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 605/1251] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:53:19.455106 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d5958a47-9a22-4e90-8f53-c9658b1ed1cc tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:19.455951 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d5958a47-9a22-4e90-8f53-c9658b1ed1cc tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:19.467948 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d5958a47-9a22-4e90-8f53-c9658b1ed1cc tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:19.468761 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d5958a47-9a22-4e90-8f53-c9658b1ed1cc tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:19.470669 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d5958a47-9a22-4e90-8f53-c9658b1ed1cc tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:19.470909 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d5958a47-9a22-4e90-8f53-c9658b1ed1cc tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:19.621509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d5958a47-9a22-4e90-8f53-c9658b1ed1cc tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:19.629585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d5958a47-9a22-4e90-8f53-c9658b1ed1cc tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1314 microversion: 2.1 time: 0.181779 Jun 29 08:53:19.630126 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 647/1252] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:19 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:20.651875 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-2f242837-6338-4413-aeb0-f301bf8a5b2c tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:20.653012 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-2f242837-6338-4413-aeb0-f301bf8a5b2c tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:20.663939 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2f242837-6338-4413-aeb0-f301bf8a5b2c tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:20.664662 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2f242837-6338-4413-aeb0-f301bf8a5b2c tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:20.665911 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2f242837-6338-4413-aeb0-f301bf8a5b2c tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:20.666617 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-2f242837-6338-4413-aeb0-f301bf8a5b2c tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:20.803587 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-2f242837-6338-4413-aeb0-f301bf8a5b2c tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:20.811612 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-2f242837-6338-4413-aeb0-f301bf8a5b2c tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1314 microversion: 2.1 time: 0.167590 Jun 29 08:53:20.812177 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 606/1253] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:20 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:21.829336 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e620d300-b930-43e9-9123-e5f3ced42892 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:21.830117 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e620d300-b930-43e9-9123-e5f3ced42892 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:21.837102 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e620d300-b930-43e9-9123-e5f3ced42892 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:21.837917 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e620d300-b930-43e9-9123-e5f3ced42892 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:21.838718 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e620d300-b930-43e9-9123-e5f3ced42892 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:21.839152 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e620d300-b930-43e9-9123-e5f3ced42892 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:21.973601 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e620d300-b930-43e9-9123-e5f3ced42892 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:21.981334 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e620d300-b930-43e9-9123-e5f3ced42892 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1314 microversion: 2.1 time: 0.156099 Jun 29 08:53:21.981926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 648/1254] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:21 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:23.002192 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d29b0fbb-c99b-48bf-9310-06b613bc7ef8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:23.003373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d29b0fbb-c99b-48bf-9310-06b613bc7ef8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:23.014555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d29b0fbb-c99b-48bf-9310-06b613bc7ef8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:23.015345 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d29b0fbb-c99b-48bf-9310-06b613bc7ef8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:23.016584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d29b0fbb-c99b-48bf-9310-06b613bc7ef8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:23.017293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d29b0fbb-c99b-48bf-9310-06b613bc7ef8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:23.166063 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d29b0fbb-c99b-48bf-9310-06b613bc7ef8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:23.173689 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d29b0fbb-c99b-48bf-9310-06b613bc7ef8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1314 microversion: 2.1 time: 0.178048 Jun 29 08:53:23.174247 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 607/1255] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:22 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:24.190804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cc2b568d-1d13-4f78-92f1-957e4610b172 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:24.191659 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cc2b568d-1d13-4f78-92f1-957e4610b172 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:24.199760 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc2b568d-1d13-4f78-92f1-957e4610b172 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:24.200474 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc2b568d-1d13-4f78-92f1-957e4610b172 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:24.200978 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc2b568d-1d13-4f78-92f1-957e4610b172 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:24.201408 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc2b568d-1d13-4f78-92f1-957e4610b172 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:24.332762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cc2b568d-1d13-4f78-92f1-957e4610b172 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:24.340761 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cc2b568d-1d13-4f78-92f1-957e4610b172 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1314 microversion: 2.1 time: 0.153923 Jun 29 08:53:24.341332 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 649/1256] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:24 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:25.362014 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d38a8699-6f3b-4cb1-8210-7e74162bcfe8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:25.363103 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d38a8699-6f3b-4cb1-8210-7e74162bcfe8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:25.373966 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d38a8699-6f3b-4cb1-8210-7e74162bcfe8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:25.375060 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d38a8699-6f3b-4cb1-8210-7e74162bcfe8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:25.376302 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d38a8699-6f3b-4cb1-8210-7e74162bcfe8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:25.377002 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d38a8699-6f3b-4cb1-8210-7e74162bcfe8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:25.526482 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d38a8699-6f3b-4cb1-8210-7e74162bcfe8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:25.534494 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d38a8699-6f3b-4cb1-8210-7e74162bcfe8 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1314 microversion: 2.1 time: 0.178913 Jun 29 08:53:25.535737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 608/1257] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:25 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:25.754340 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-d03ab533-276a-4b9c-8c3c-4e463c7550e1 req-5d78492a-970a-4ff7-8f38-e32e9f444f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a631b9-92fc-4034-82c8-fd2322d2ecfb", "name": "network-vif-plugged", "status": "completed", "tag": "a82e4219-d279-4a96-a7d9-ca2c715acfd0"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:53:25.764517 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-d03ab533-276a-4b9c-8c3c-4e463c7550e1 req-5d78492a-970a-4ff7-8f38-e32e9f444f44 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:25.765183 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-d03ab533-276a-4b9c-8c3c-4e463c7550e1 req-5d78492a-970a-4ff7-8f38-e32e9f444f44 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:25.777475 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-d03ab533-276a-4b9c-8c3c-4e463c7550e1 req-5d78492a-970a-4ff7-8f38-e32e9f444f44 service nova] Creating event network-vif-plugged:a82e4219-d279-4a96-a7d9-ca2c715acfd0 for instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb on hv-cinder-79760 Jun 29 08:53:25.783166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-d03ab533-276a-4b9c-8c3c-4e463c7550e1 req-5d78492a-970a-4ff7-8f38-e32e9f444f44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152455 Jun 29 08:53:25.783719 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 650/1258] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:53:26.554384 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-566d863a-58a7-451d-a1f9-fade1ef38152 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:26.554993 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-566d863a-58a7-451d-a1f9-fade1ef38152 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:26.558080 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:26.558981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:26.564342 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-566d863a-58a7-451d-a1f9-fade1ef38152 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:26.564788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-566d863a-58a7-451d-a1f9-fade1ef38152 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:26.565555 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-566d863a-58a7-451d-a1f9-fade1ef38152 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:26.566174 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-566d863a-58a7-451d-a1f9-fade1ef38152 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:26.700381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-566d863a-58a7-451d-a1f9-fade1ef38152 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:26.708246 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-566d863a-58a7-451d-a1f9-fade1ef38152 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1314 microversion: 2.1 time: 0.158949 Jun 29 08:53:26.708812 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 609/1259] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:26 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:27.725478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:27.733322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-56173666-55f2-40e4-b0af-983acc54373f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:27.734475 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-56173666-55f2-40e4-b0af-983acc54373f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:27.745386 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-56173666-55f2-40e4-b0af-983acc54373f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:27.745886 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-56173666-55f2-40e4-b0af-983acc54373f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:27.747297 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-56173666-55f2-40e4-b0af-983acc54373f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:27.748035 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-56173666-55f2-40e4-b0af-983acc54373f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:27.897169 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-56173666-55f2-40e4-b0af-983acc54373f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:27.904799 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-56173666-55f2-40e4-b0af-983acc54373f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1498 microversion: 2.1 time: 0.181503 Jun 29 08:53:27.905365 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 651/1260] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:27 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:28.410642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6816efee-b2ed-4b46-ac97-62b8611aec44 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:28.411190 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6816efee-b2ed-4b46-ac97-62b8611aec44 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:28.417981 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6816efee-b2ed-4b46-ac97-62b8611aec44 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:28.418414 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6816efee-b2ed-4b46-ac97-62b8611aec44 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:28.419189 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6816efee-b2ed-4b46-ac97-62b8611aec44 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:28.419606 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6816efee-b2ed-4b46-ac97-62b8611aec44 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:28.444987 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6816efee-b2ed-4b46-ac97-62b8611aec44 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:53:28.530506 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6816efee-b2ed-4b46-ac97-62b8611aec44 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 204 len: 0 microversion: 2.1 time: 0.123236 Jun 29 08:53:28.531210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 610/1261] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:53:28 2022] DELETE /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:53:28.540009 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4abcdfed-379c-4a6b-9349-6aa46405e05e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:28.540603 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4abcdfed-379c-4a6b-9349-6aa46405e05e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:28.546857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4abcdfed-379c-4a6b-9349-6aa46405e05e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:28.547308 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4abcdfed-379c-4a6b-9349-6aa46405e05e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:28.548364 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4abcdfed-379c-4a6b-9349-6aa46405e05e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:28.548795 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4abcdfed-379c-4a6b-9349-6aa46405e05e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:28.701795 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4abcdfed-379c-4a6b-9349-6aa46405e05e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:28.711838 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4abcdfed-379c-4a6b-9349-6aa46405e05e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1504 microversion: 2.1 time: 0.175995 Jun 29 08:53:28.712404 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 652/1262] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:28 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:29.730240 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-fe22ee74-25fa-46c5-b071-2abd092b5f7f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:29.730881 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-fe22ee74-25fa-46c5-b071-2abd092b5f7f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:29.737546 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fe22ee74-25fa-46c5-b071-2abd092b5f7f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:29.737983 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fe22ee74-25fa-46c5-b071-2abd092b5f7f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:29.738734 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fe22ee74-25fa-46c5-b071-2abd092b5f7f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:29.739187 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-fe22ee74-25fa-46c5-b071-2abd092b5f7f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:29.872021 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-fe22ee74-25fa-46c5-b071-2abd092b5f7f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:29.879676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-fe22ee74-25fa-46c5-b071-2abd092b5f7f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1504 microversion: 2.1 time: 0.153779 Jun 29 08:53:29.880212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 611/1263] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:29 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:30.897049 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4c6ea5cb-39a7-478e-99fd-3bec1e6e548d tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:30.897745 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4c6ea5cb-39a7-478e-99fd-3bec1e6e548d tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:30.908708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-f1cf1143-2e83-4cb9-864a-47d0ffb6ac4f req-3311211a-0b1c-46b8-a138-e783995cb174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a631b9-92fc-4034-82c8-fd2322d2ecfb", "name": "network-vif-deleted", "tag": "a82e4219-d279-4a96-a7d9-ca2c715acfd0"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:53:30.913162 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4c6ea5cb-39a7-478e-99fd-3bec1e6e548d tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:30.913976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4c6ea5cb-39a7-478e-99fd-3bec1e6e548d tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:30.916048 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4c6ea5cb-39a7-478e-99fd-3bec1e6e548d tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:30.916513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4c6ea5cb-39a7-478e-99fd-3bec1e6e548d tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:30.917465 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f1cf1143-2e83-4cb9-864a-47d0ffb6ac4f req-3311211a-0b1c-46b8-a138-e783995cb174 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:30.917972 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f1cf1143-2e83-4cb9-864a-47d0ffb6ac4f req-3311211a-0b1c-46b8-a138-e783995cb174 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:30.930052 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-f1cf1143-2e83-4cb9-864a-47d0ffb6ac4f req-3311211a-0b1c-46b8-a138-e783995cb174 service nova] Creating event network-vif-deleted:a82e4219-d279-4a96-a7d9-ca2c715acfd0 for instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb on hv-cinder-79760 Jun 29 08:53:30.935348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-f1cf1143-2e83-4cb9-864a-47d0ffb6ac4f req-3311211a-0b1c-46b8-a138-e783995cb174 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033551 Jun 29 08:53:30.939085 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 612/1264] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:53:30.993510 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4c6ea5cb-39a7-478e-99fd-3bec1e6e548d tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:31.001337 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4c6ea5cb-39a7-478e-99fd-3bec1e6e548d tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 200 len: 1462 microversion: 2.1 time: 0.108396 Jun 29 08:53:31.002143 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 653/1265] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:30 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 1462 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:32.022800 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:32.023497 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 87a631b9-92fc-4034-82c8-fd2322d2ecfb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:32.033704 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:32.034425 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:32.035724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:32.036432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:32.052017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] HTTP exception thrown: Instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb could not be found. Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Request method failure captured: Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb HTTP/1.1 Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivBL5gc9NG40QH2h5NuTijf5PLA1cGSiNH1ouj5SblNYLHfZKVio-xcKzDui93nkJ2WGhhKkkXvTMEJFV2jfIYr69QqL4WLM4HVNcIM5ScURvpt8aC0heKfCjBoDyC6RzRmNEnq0W9MIeprYXw3J2jneZxwSL4t34a8-MuSFB7mynOO0 Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 37185eb6b2dd4375a6909aaefe1cc7f5 Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-VolumesActionsTest-60708206 Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:53:32.053622 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/37185eb6b2dd4375a6909aaefe1cc7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37185eb6b2dd4375a6909aaefe1cc7f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37185eb6b2dd4375a6909aaefe1cc7f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_37185eb6b2dd4375a6909aaefe1cc7f5"}]}] Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-VolumesActionsTest-60708206 Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 37185eb6b2dd4375a6909aaefe1cc7f5 Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-VolumesActionsTest-60708206 Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-VolumesActionsTest-60708206-project Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 3ed513efcdf04cc48abcb078e857c025 Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-VolumesActionsTest-60708206-project Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb could not be found. Jun 29 08:53:32.055381 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '87a631b9-92fc-4034-82c8-fd2322d2ecfb'} Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb could not be found. Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:53:32.056581 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb could not be found. Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb could not be found. Jun 29 08:53:32.058282 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:32.059790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Returning 404 to user: Instance 87a631b9-92fc-4034-82c8-fd2322d2ecfb could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:53:32.059790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6fdbc0f1-611f-4739-a179-ee7a3a10b404 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb" status: 404 len: 111 microversion: 2.1 time: 0.038648 Jun 29 08:53:32.059790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 613/1266] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:32 2022] GET /compute/v2.1/servers/87a631b9-92fc-4034-82c8-fd2322d2ecfb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:53:32.107207 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1640930558", "imageRef": "719ab637-1c15-4901-b5b1-027218eec422", "flavorRef": "452", "networks": [{"uuid": "83feb3a3-f15e-4205-88ed-cea7ef36493b"}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:53:32.161967 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] validate_networks() for [('83feb3a3-f15e-4205-88ed-cea7ef36493b', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:53:32.578847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:53:32.579255 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:53:32.579722 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:53:32.580123 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:53:32.580526 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:53:32.591140 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:32.591573 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:32.592353 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:32.592774 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:32.609742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Getting quotas for project 37185eb6b2dd4375a6909aaefe1cc7f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:53:32.613737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Getting quotas for user 3ed513efcdf04cc48abcb078e857c025 and project 37185eb6b2dd4375a6909aaefe1cc7f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:53:32.626020 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:53:32.628402 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719ab637-1c15-4901-b5b1-027218eec422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:53:32.672759 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [06996ec8-325d-486c-8d52-acfa98073bde] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 08:53:33.686201 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [06996ec8-325d-486c-8d52-acfa98073bde] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 33918. Jun 29 08:53:33.693976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-65b0ed70-2c4f-478c-8fed-21e6fa5689b6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590331 Jun 29 08:53:33.695041 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 654/1267] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:53:33.705469 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-5df6116b-99bf-4697-bdc4-8112518cce89 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:33.706029 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-5df6116b-99bf-4697-bdc4-8112518cce89 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:33.770064 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-5df6116b-99bf-4697-bdc4-8112518cce89 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:33.777375 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-5df6116b-99bf-4697-bdc4-8112518cce89 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1214 microversion: 2.1 time: 0.075789 Jun 29 08:53:33.777937 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 614/1268] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:33 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:34.795016 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-156879a1-5d43-4c32-8eb4-d3793ea32776 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:34.795679 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-156879a1-5d43-4c32-8eb4-d3793ea32776 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:34.848748 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-156879a1-5d43-4c32-8eb4-d3793ea32776 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:34.856725 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-156879a1-5d43-4c32-8eb4-d3793ea32776 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1214 microversion: 2.1 time: 0.065855 Jun 29 08:53:34.857746 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 655/1269] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:34 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:35.875950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b42a561f-e2a9-4273-b5eb-77d6c54c3427 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:35.876549 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b42a561f-e2a9-4273-b5eb-77d6c54c3427 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:35.931387 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b42a561f-e2a9-4273-b5eb-77d6c54c3427 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:35.938142 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b42a561f-e2a9-4273-b5eb-77d6c54c3427 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1214 microversion: 2.1 time: 0.066166 Jun 29 08:53:35.938869 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 615/1270] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:35 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:36.960073 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-77156432-8677-4db2-adcd-7e52f7b4dd95 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:36.961034 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-77156432-8677-4db2-adcd-7e52f7b4dd95 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:37.019062 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-77156432-8677-4db2-adcd-7e52f7b4dd95 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:37.026374 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-77156432-8677-4db2-adcd-7e52f7b4dd95 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1214 microversion: 2.1 time: 0.072786 Jun 29 08:53:37.026961 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 656/1271] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:36 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:38.047788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-ea984c9f-ae36-4822-ab62-bb7dd6d9b959 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:38.048749 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-ea984c9f-ae36-4822-ab62-bb7dd6d9b959 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:38.059864 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea984c9f-ae36-4822-ab62-bb7dd6d9b959 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:38.060580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea984c9f-ae36-4822-ab62-bb7dd6d9b959 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:38.061827 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea984c9f-ae36-4822-ab62-bb7dd6d9b959 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:38.062537 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-ea984c9f-ae36-4822-ab62-bb7dd6d9b959 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:38.129805 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-ea984c9f-ae36-4822-ab62-bb7dd6d9b959 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:38.137537 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-ea984c9f-ae36-4822-ab62-bb7dd6d9b959 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1218 microversion: 2.1 time: 0.096375 Jun 29 08:53:38.138092 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 616/1272] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:38 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:39.154151 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-db2ae0db-db1c-4c0f-806c-12880857671f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:39.155569 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-db2ae0db-db1c-4c0f-806c-12880857671f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:39.163322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db2ae0db-db1c-4c0f-806c-12880857671f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:39.163771 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db2ae0db-db1c-4c0f-806c-12880857671f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:39.164537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db2ae0db-db1c-4c0f-806c-12880857671f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:39.164965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db2ae0db-db1c-4c0f-806c-12880857671f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:39.227720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-db2ae0db-db1c-4c0f-806c-12880857671f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:39.235662 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-db2ae0db-db1c-4c0f-806c-12880857671f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1272 microversion: 2.1 time: 0.085994 Jun 29 08:53:39.236437 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 657/1273] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:39 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:40.182710 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-f4750b72-4fe2-4f6f-bae6-c88118858587 req-7b279e9e-27ab-4443-b8e5-dd727c305b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca4fb12-8af6-49c7-853e-5906676aa7f9", "tag": "d013f476-66d9-43ce-819e-2b440bffa7fb"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:53:40.192082 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f4750b72-4fe2-4f6f-bae6-c88118858587 req-7b279e9e-27ab-4443-b8e5-dd727c305b21 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:40.193505 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-f4750b72-4fe2-4f6f-bae6-c88118858587 req-7b279e9e-27ab-4443-b8e5-dd727c305b21 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:40.206398 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-f4750b72-4fe2-4f6f-bae6-c88118858587 req-7b279e9e-27ab-4443-b8e5-dd727c305b21 service nova] Creating event network-changed:d013f476-66d9-43ce-819e-2b440bffa7fb for instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 on hv-cinder-79760 Jun 29 08:53:40.212077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-f4750b72-4fe2-4f6f-bae6-c88118858587 req-7b279e9e-27ab-4443-b8e5-dd727c305b21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034427 Jun 29 08:53:40.213186 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 617/1274] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:53:40.253339 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0536e007-a42f-4f50-baf5-5ef89d3d1ed3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:40.253958 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0536e007-a42f-4f50-baf5-5ef89d3d1ed3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:40.260716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0536e007-a42f-4f50-baf5-5ef89d3d1ed3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:40.261156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0536e007-a42f-4f50-baf5-5ef89d3d1ed3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:40.261950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0536e007-a42f-4f50-baf5-5ef89d3d1ed3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:40.262415 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0536e007-a42f-4f50-baf5-5ef89d3d1ed3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:40.394724 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0536e007-a42f-4f50-baf5-5ef89d3d1ed3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:40.402540 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0536e007-a42f-4f50-baf5-5ef89d3d1ed3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1314 microversion: 2.1 time: 0.153202 Jun 29 08:53:40.403184 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 658/1275] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:40 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:41.420461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-02cb3d12-7767-43dc-8701-be8d5110de53 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:41.421198 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-02cb3d12-7767-43dc-8701-be8d5110de53 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:41.427814 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-02cb3d12-7767-43dc-8701-be8d5110de53 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:41.428257 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-02cb3d12-7767-43dc-8701-be8d5110de53 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:41.429008 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-02cb3d12-7767-43dc-8701-be8d5110de53 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:41.429431 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-02cb3d12-7767-43dc-8701-be8d5110de53 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:41.822595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-02cb3d12-7767-43dc-8701-be8d5110de53 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:41.830155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-02cb3d12-7767-43dc-8701-be8d5110de53 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1314 microversion: 2.1 time: 0.414189 Jun 29 08:53:41.830735 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 618/1276] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:41 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:42.108770 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:53:42.108959 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 08:53:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:53:42.847937 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5aaba204-d463-4f5f-aa79-e589a654eef1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:42.848583 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5aaba204-d463-4f5f-aa79-e589a654eef1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:42.851975 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:42.856279 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5aaba204-d463-4f5f-aa79-e589a654eef1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:42.856841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5aaba204-d463-4f5f-aa79-e589a654eef1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:42.857904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5aaba204-d463-4f5f-aa79-e589a654eef1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:42.858376 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5aaba204-d463-4f5f-aa79-e589a654eef1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:42.990095 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5aaba204-d463-4f5f-aa79-e589a654eef1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:42.997830 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5aaba204-d463-4f5f-aa79-e589a654eef1 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1314 microversion: 2.1 time: 0.153826 Jun 29 08:53:42.998355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 659/1277] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:42 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:44.020660 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b71002e8-a2a0-4111-8f0c-6239cdcc9223 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:44.021580 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b71002e8-a2a0-4111-8f0c-6239cdcc9223 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:44.033723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b71002e8-a2a0-4111-8f0c-6239cdcc9223 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:44.034407 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b71002e8-a2a0-4111-8f0c-6239cdcc9223 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:44.035708 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b71002e8-a2a0-4111-8f0c-6239cdcc9223 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:44.036406 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b71002e8-a2a0-4111-8f0c-6239cdcc9223 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:44.172980 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b71002e8-a2a0-4111-8f0c-6239cdcc9223 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:44.180669 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b71002e8-a2a0-4111-8f0c-6239cdcc9223 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1314 microversion: 2.1 time: 0.168118 Jun 29 08:53:44.181268 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 619/1278] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:44 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:45.200036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b18f0610-556f-49d5-ac6e-49432388ebda tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:45.200624 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b18f0610-556f-49d5-ac6e-49432388ebda tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:45.210448 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b18f0610-556f-49d5-ac6e-49432388ebda tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:45.210953 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b18f0610-556f-49d5-ac6e-49432388ebda tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:45.211841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b18f0610-556f-49d5-ac6e-49432388ebda tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:45.212345 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b18f0610-556f-49d5-ac6e-49432388ebda tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:45.347952 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b18f0610-556f-49d5-ac6e-49432388ebda tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:45.360032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b18f0610-556f-49d5-ac6e-49432388ebda tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1314 microversion: 2.1 time: 0.165607 Jun 29 08:53:45.360825 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 660/1279] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:45 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:45.764596 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-c554946e-9725-46d5-beb7-c0597dd51124 req-5d1d42e7-9f7d-4f5c-90af-4baaa93558fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca4fb12-8af6-49c7-853e-5906676aa7f9", "name": "network-vif-plugged", "status": "completed", "tag": "d013f476-66d9-43ce-819e-2b440bffa7fb"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:53:45.768634 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:45.775334 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-c554946e-9725-46d5-beb7-c0597dd51124 req-5d1d42e7-9f7d-4f5c-90af-4baaa93558fa service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:45.775782 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-c554946e-9725-46d5-beb7-c0597dd51124 req-5d1d42e7-9f7d-4f5c-90af-4baaa93558fa service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:45.782458 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:45.790842 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-c554946e-9725-46d5-beb7-c0597dd51124 req-5d1d42e7-9f7d-4f5c-90af-4baaa93558fa service nova] Creating event network-vif-plugged:d013f476-66d9-43ce-819e-2b440bffa7fb for instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 on hv-cinder-79760 Jun 29 08:53:45.797363 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-c554946e-9725-46d5-beb7-c0597dd51124 req-5d1d42e7-9f7d-4f5c-90af-4baaa93558fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036134 Jun 29 08:53:45.797942 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 620/1280] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:53:46.380950 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8e249e57-577e-4898-8916-d4e8e7ad1e1e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:46.381867 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8e249e57-577e-4898-8916-d4e8e7ad1e1e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:46.385683 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:46.391976 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e249e57-577e-4898-8916-d4e8e7ad1e1e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:46.392418 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e249e57-577e-4898-8916-d4e8e7ad1e1e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:46.393179 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e249e57-577e-4898-8916-d4e8e7ad1e1e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:46.393604 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e249e57-577e-4898-8916-d4e8e7ad1e1e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:46.396852 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=72 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:46.532616 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8e249e57-577e-4898-8916-d4e8e7ad1e1e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:46.540658 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8e249e57-577e-4898-8916-d4e8e7ad1e1e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1314 microversion: 2.1 time: 0.165708 Jun 29 08:53:46.541218 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 661/1281] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:46 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:47.556017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=4 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:47.562939 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-f7fe1365-fae6-4399-863d-e075d806b9d6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:47.563650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-f7fe1365-fae6-4399-863d-e075d806b9d6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:47.571906 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f7fe1365-fae6-4399-863d-e075d806b9d6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:47.572348 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f7fe1365-fae6-4399-863d-e075d806b9d6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:47.573125 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f7fe1365-fae6-4399-863d-e075d806b9d6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:47.573548 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-f7fe1365-fae6-4399-863d-e075d806b9d6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:47.719186 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-f7fe1365-fae6-4399-863d-e075d806b9d6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:47.732880 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-f7fe1365-fae6-4399-863d-e075d806b9d6 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1498 microversion: 2.1 time: 0.177975 Jun 29 08:53:47.734009 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 621/1282] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:47 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1498 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:48.262164 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cb53a968-951c-4a09-b66e-f11ab66117c5 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:48.262752 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cb53a968-951c-4a09-b66e-f11ab66117c5 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:48.264544 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=10 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:53:48.270638 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb53a968-951c-4a09-b66e-f11ab66117c5 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:48.271115 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb53a968-951c-4a09-b66e-f11ab66117c5 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:48.271876 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb53a968-951c-4a09-b66e-f11ab66117c5 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:48.272311 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb53a968-951c-4a09-b66e-f11ab66117c5 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:48.298104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cb53a968-951c-4a09-b66e-f11ab66117c5 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:53:48.378314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cb53a968-951c-4a09-b66e-f11ab66117c5 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 204 len: 0 microversion: 2.1 time: 0.119796 Jun 29 08:53:48.379054 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 662/1283] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:53:48 2022] DELETE /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:53:48.387886 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-23b7e3f5-a735-471e-b71b-ead4c2e8470e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:48.388503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-23b7e3f5-a735-471e-b71b-ead4c2e8470e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:48.394820 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23b7e3f5-a735-471e-b71b-ead4c2e8470e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:48.395272 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23b7e3f5-a735-471e-b71b-ead4c2e8470e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:48.396040 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23b7e3f5-a735-471e-b71b-ead4c2e8470e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:48.396475 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-23b7e3f5-a735-471e-b71b-ead4c2e8470e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:48.530666 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-23b7e3f5-a735-471e-b71b-ead4c2e8470e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:48.542132 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-23b7e3f5-a735-471e-b71b-ead4c2e8470e tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1504 microversion: 2.1 time: 0.158041 Jun 29 08:53:48.543109 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 622/1284] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:48 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:49.565943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-12c3f65c-a63e-4d71-9512-b9f7f610667f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:49.566826 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-12c3f65c-a63e-4d71-9512-b9f7f610667f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:49.575190 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-12c3f65c-a63e-4d71-9512-b9f7f610667f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:49.575737 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-12c3f65c-a63e-4d71-9512-b9f7f610667f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:49.576669 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-12c3f65c-a63e-4d71-9512-b9f7f610667f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:49.577194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-12c3f65c-a63e-4d71-9512-b9f7f610667f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:49.721493 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-12c3f65c-a63e-4d71-9512-b9f7f610667f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:49.729277 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-12c3f65c-a63e-4d71-9512-b9f7f610667f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1504 microversion: 2.1 time: 0.169801 Jun 29 08:53:49.729841 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 663/1285] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:49 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:50.384249 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-2a148ecc-baa3-4ec5-ab32-06b535df42e4 req-3bc146db-bfe7-4ec2-9742-6386e64e5f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca4fb12-8af6-49c7-853e-5906676aa7f9", "name": "network-vif-deleted", "tag": "d013f476-66d9-43ce-819e-2b440bffa7fb"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:53:50.393323 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-2a148ecc-baa3-4ec5-ab32-06b535df42e4 req-3bc146db-bfe7-4ec2-9742-6386e64e5f07 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:50.393752 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-2a148ecc-baa3-4ec5-ab32-06b535df42e4 req-3bc146db-bfe7-4ec2-9742-6386e64e5f07 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:50.405269 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-2a148ecc-baa3-4ec5-ab32-06b535df42e4 req-3bc146db-bfe7-4ec2-9742-6386e64e5f07 service nova] Creating event network-vif-deleted:d013f476-66d9-43ce-819e-2b440bffa7fb for instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 on hv-cinder-79760 Jun 29 08:53:50.412353 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-2a148ecc-baa3-4ec5-ab32-06b535df42e4 req-3bc146db-bfe7-4ec2-9742-6386e64e5f07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031917 Jun 29 08:53:50.412950 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 623/1286] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:53:50.750627 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:50.751613 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:50.762590 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:50.763372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:50.764622 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:50.765322 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:50.797738 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:50.798186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:50.798631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lazy-loading 'fault' on Instance uuid 4ca4fb12-8af6-49c7-853e-5906676aa7f9 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:53:50.841221 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed513efcdf04cc48abcb078e857c025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37185eb6b2dd4375a6909aaefe1cc7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:53:50.850677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f68eafc1-1b8d-4f9b-af08-c8b9b9e76c4f tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 200 len: 1304 microversion: 2.1 time: 0.106516 Jun 29 08:53:50.851416 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 664/1287] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:50 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:53:51.874248 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:53:51.875503 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] [instance: 4ca4fb12-8af6-49c7-853e-5906676aa7f9] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:53:51.882790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:51.883224 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:51.884078 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:53:51.884507 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:53:51.898158 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.wsgi [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] HTTP exception thrown: Instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 could not be found. Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Request method failure captured: Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: request: GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 HTTP/1.1 Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept: application/json Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Accept-Encoding: identity Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Connection: close Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Length: 0 Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Content-Type: application/json Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Host: 10.222.0.27 Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Openstack-System-Scope: None Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: User-Agent: python-urllib3/1.26.9 Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Auth-Token: gAAAAABivBL5gc9NG40QH2h5NuTijf5PLA1cGSiNH1ouj5SblNYLHfZKVio-xcKzDui93nkJ2WGhhKkkXvTMEJFV2jfIYr69QqL4WLM4HVNcIM5ScURvpt8aC0heKfCjBoDyC6RzRmNEnq0W9MIeprYXw3J2jneZxwSL4t34a8-MuSFB7mynOO0 Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Id: None Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Domain-Name: None Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Identity-Status: Confirmed Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Is-Admin-Project: True Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Id: default Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Domain-Name: Default Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Id: 37185eb6b2dd4375a6909aaefe1cc7f5 Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Project-Name: tempest-VolumesActionsTest-60708206 Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Role: reader,member Jun 29 08:53:51.899831 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Roles: reader,member Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/37185eb6b2dd4375a6909aaefe1cc7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37185eb6b2dd4375a6909aaefe1cc7f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37185eb6b2dd4375a6909aaefe1cc7f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_37185eb6b2dd4375a6909aaefe1cc7f5"}]}] Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant: tempest-VolumesActionsTest-60708206 Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Id: 37185eb6b2dd4375a6909aaefe1cc7f5 Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-Tenant-Name: tempest-VolumesActionsTest-60708206 Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User: tempest-VolumesActionsTest-60708206-project Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Id: default Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Domain-Name: Default Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Id: 3ed513efcdf04cc48abcb078e857c025 Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: X-User-Name: tempest-VolumesActionsTest-60708206-project Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: method: > Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: exception: Instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 could not be found. Jun 29 08:53:51.901571 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: action_args: {'id': '4ca4fb12-8af6-49c7-853e-5906676aa7f9'} Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 could not be found. Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:53:51.902476 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 could not be found. Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 could not be found. Jun 29 08:53:51.904077 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: ERROR nova.api.openstack.wsgi Jun 29 08:53:51.905566 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] Returning 404 to user: Instance 4ca4fb12-8af6-49c7-853e-5906676aa7f9 could not be found. {{(pid=124265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:53:51.905566 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a8c726a0-2fa5-4895-874e-0471936604b3 tempest-VolumesActionsTest-60708206 tempest-VolumesActionsTest-60708206-project] 10.222.0.27 "GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9" status: 404 len: 111 microversion: 2.1 time: 0.034900 Jun 29 08:53:51.905566 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 624/1288] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:53:51 2022] GET /compute/v2.1/servers/4ca4fb12-8af6-49c7-853e-5906676aa7f9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:55:16.568716 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:16.569560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:16.574224 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d2447c65-c51f-40ae-af27-f45c5211dd1b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Action: 'create', calling method: .version_select at 0x7fade42a0ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1641872344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6w+Naoee8sOuGMOkVzcJCdjfISwRgPz72G7j4jQCqxNoqNtgo3G4oAIFueR5rV8XFIQlTLR65ZtHPuZ3jB0t9ONkZ+CCK/itcV+trwt5T+t+XeF0V9QvcW/4Th4VvoPg=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:55:16.591384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-d2447c65-c51f-40ae-af27-f45c5211dd1b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Getting quotas for project 50a457f985c4496ca41152bfa29ae9e3. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:55:16.595546 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-d2447c65-c51f-40ae-af27-f45c5211dd1b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Getting quotas for user 340cc4d0b4c543fab577749f947598b1 and project 50a457f985c4496ca41152bfa29ae9e3. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:55:16.608993 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d2447c65-c51f-40ae-af27-f45c5211dd1b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [f771732b-6ce1-4921-8da3-48df4f205056] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 08:55:17.618789 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [None req-d2447c65-c51f-40ae-af27-f45c5211dd1b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [f771732b-6ce1-4921-8da3-48df4f205056] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34602. Jun 29 08:55:17.647894 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d2447c65-c51f-40ae-af27-f45c5211dd1b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.081075 Jun 29 08:55:17.648713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 665/1289] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Jun 29 08:55:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:55:17.707091 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=9 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:17.707832 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=17 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:17.712723 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1437339833", "imageRef": "ab0bb973-2e90-485e-aa1c-c3eca0be536c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1641872344", "networks": [{"uuid": "976e00b0-a712-452c-8c58-d1819d97dd27"}]}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:55:17.776717 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.network.neutron [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] validate_networks() for [('976e00b0-a712-452c-8c58-d1819d97dd27', None, None, None, None, None)] {{(pid=124265) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:55:18.211340 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Flavor limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:55:18.211762 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Image limits 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:55:18.212615 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Flavor pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:55:18.213056 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Image pref 0:0:0 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:55:18.213813 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.virt.hardware [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:55:18.225914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:18.226651 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:18.227969 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:18.228687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:18.247953 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Getting quotas for project 50a457f985c4496ca41152bfa29ae9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:55:18.252469 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.quota [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Getting quotas for user 340cc4d0b4c543fab577749f947598b1 and project 50a457f985c4496ca41152bfa29ae9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=124265) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:55:18.265302 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Going to run 1 instances... {{(pid=124265) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:55:18.267559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab0bb973-2e90-485e-aa1c-c3eca0be536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:55:18.316716 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3ecc3da6-4a07-4235-95e0-19be91d10349 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611282 Jun 29 08:55:18.317736 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 625/1290] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Jun 29 08:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:55:18.328387 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d5860531-9d53-4975-8371-6afc9651763b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:18.329002 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d5860531-9d53-4975-8371-6afc9651763b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:18.383341 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d5860531-9d53-4975-8371-6afc9651763b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:18.391223 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d5860531-9d53-4975-8371-6afc9651763b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1259 microversion: 2.1 time: 0.066817 Jun 29 08:55:18.391788 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 666/1291] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:18 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:19.410505 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-56caddb4-139e-49a7-bb62-48b04af507a7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:19.411249 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-56caddb4-139e-49a7-bb62-48b04af507a7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:19.418795 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-56caddb4-139e-49a7-bb62-48b04af507a7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:19.419335 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-56caddb4-139e-49a7-bb62-48b04af507a7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:19.420351 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-56caddb4-139e-49a7-bb62-48b04af507a7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:19.420847 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-56caddb4-139e-49a7-bb62-48b04af507a7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:19.484205 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-56caddb4-139e-49a7-bb62-48b04af507a7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:19.499179 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-56caddb4-139e-49a7-bb62-48b04af507a7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1329 microversion: 2.1 time: 0.094245 Jun 29 08:55:19.500402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 626/1292] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:19 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1329 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:20.519667 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bee4f092-9625-4a4d-8082-633829032783 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:20.520372 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bee4f092-9625-4a4d-8082-633829032783 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:20.527364 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bee4f092-9625-4a4d-8082-633829032783 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:20.527801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bee4f092-9625-4a4d-8082-633829032783 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:20.528579 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bee4f092-9625-4a4d-8082-633829032783 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:20.529170 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bee4f092-9625-4a4d-8082-633829032783 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:20.692113 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bee4f092-9625-4a4d-8082-633829032783 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:20.701316 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bee4f092-9625-4a4d-8082-633829032783 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.187702 Jun 29 08:55:20.702114 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 667/1293] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:20 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:21.720430 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-710953ec-2b21-4fd6-8ad7-5556819c52e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:21.721028 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-710953ec-2b21-4fd6-8ad7-5556819c52e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:21.727773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-710953ec-2b21-4fd6-8ad7-5556819c52e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:21.728211 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-710953ec-2b21-4fd6-8ad7-5556819c52e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:21.728975 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-710953ec-2b21-4fd6-8ad7-5556819c52e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:21.729742 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-710953ec-2b21-4fd6-8ad7-5556819c52e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:21.865448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-710953ec-2b21-4fd6-8ad7-5556819c52e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:21.874876 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-710953ec-2b21-4fd6-8ad7-5556819c52e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.158308 Jun 29 08:55:21.876396 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 627/1294] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:21 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:22.893190 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0bff538b-dd50-4c21-b4b7-74e0c3b6cdf5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:22.893877 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0bff538b-dd50-4c21-b4b7-74e0c3b6cdf5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:22.900801 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0bff538b-dd50-4c21-b4b7-74e0c3b6cdf5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:22.901513 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0bff538b-dd50-4c21-b4b7-74e0c3b6cdf5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:22.902344 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0bff538b-dd50-4c21-b4b7-74e0c3b6cdf5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:22.902863 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0bff538b-dd50-4c21-b4b7-74e0c3b6cdf5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:23.051713 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0bff538b-dd50-4c21-b4b7-74e0c3b6cdf5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:23.059568 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0bff538b-dd50-4c21-b4b7-74e0c3b6cdf5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.170353 Jun 29 08:55:23.060142 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 668/1295] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:22 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:55:24.077204 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-a2df742c-9efb-4cdb-a854-2ec52f5c4c93 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:24.077929 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-a2df742c-9efb-4cdb-a854-2ec52f5c4c93 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:24.084675 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2df742c-9efb-4cdb-a854-2ec52f5c4c93 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:24.085110 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2df742c-9efb-4cdb-a854-2ec52f5c4c93 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:24.085852 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2df742c-9efb-4cdb-a854-2ec52f5c4c93 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:24.086276 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-a2df742c-9efb-4cdb-a854-2ec52f5c4c93 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:24.258527 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-a2df742c-9efb-4cdb-a854-2ec52f5c4c93 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:24.266628 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-a2df742c-9efb-4cdb-a854-2ec52f5c4c93 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.193428 Jun 29 08:55:24.267449 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 628/1296] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:24 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:25.284045 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c8fbefaa-d5f8-4f12-a65b-bea3e3d515bc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:25.284676 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c8fbefaa-d5f8-4f12-a65b-bea3e3d515bc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:25.291860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c8fbefaa-d5f8-4f12-a65b-bea3e3d515bc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:25.292780 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c8fbefaa-d5f8-4f12-a65b-bea3e3d515bc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:25.293328 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c8fbefaa-d5f8-4f12-a65b-bea3e3d515bc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:25.293776 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c8fbefaa-d5f8-4f12-a65b-bea3e3d515bc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:25.431681 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c8fbefaa-d5f8-4f12-a65b-bea3e3d515bc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:25.444749 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c8fbefaa-d5f8-4f12-a65b-bea3e3d515bc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.164630 Jun 29 08:55:25.445648 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 669/1297] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:25 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:26.462006 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-13d6c100-f539-483a-a4a1-dea551848f95 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:26.463222 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-13d6c100-f539-483a-a4a1-dea551848f95 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:26.470777 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-13d6c100-f539-483a-a4a1-dea551848f95 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:26.471227 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-13d6c100-f539-483a-a4a1-dea551848f95 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:26.472009 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-13d6c100-f539-483a-a4a1-dea551848f95 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:26.472444 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-13d6c100-f539-483a-a4a1-dea551848f95 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:26.630181 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-13d6c100-f539-483a-a4a1-dea551848f95 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:26.638738 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-13d6c100-f539-483a-a4a1-dea551848f95 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.180535 Jun 29 08:55:26.639325 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 629/1298] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:26 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:27.660056 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a4a2efa8-e734-4a7f-9463-90a98531b7f5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:27.661057 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a4a2efa8-e734-4a7f-9463-90a98531b7f5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:27.672355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4a2efa8-e734-4a7f-9463-90a98531b7f5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:27.673101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4a2efa8-e734-4a7f-9463-90a98531b7f5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:27.674350 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4a2efa8-e734-4a7f-9463-90a98531b7f5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:27.675116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4a2efa8-e734-4a7f-9463-90a98531b7f5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:27.822432 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a4a2efa8-e734-4a7f-9463-90a98531b7f5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:27.830398 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a4a2efa8-e734-4a7f-9463-90a98531b7f5 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.176966 Jun 29 08:55:27.830969 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 670/1299] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:27 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:28.851870 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-29bdd476-2a97-43f3-a1d5-00b93c99e61e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:28.852802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-29bdd476-2a97-43f3-a1d5-00b93c99e61e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:28.856335 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=2 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:28.857003 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell0:SELECT=6 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:28.863510 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-29bdd476-2a97-43f3-a1d5-00b93c99e61e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:28.863990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-29bdd476-2a97-43f3-a1d5-00b93c99e61e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:28.864773 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-29bdd476-2a97-43f3-a1d5-00b93c99e61e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:28.865201 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-29bdd476-2a97-43f3-a1d5-00b93c99e61e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:29.005466 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-29bdd476-2a97-43f3-a1d5-00b93c99e61e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:29.017523 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-29bdd476-2a97-43f3-a1d5-00b93c99e61e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.172007 Jun 29 08:55:29.018393 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 630/1300] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:28 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:30.042382 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6291f109-ec91-4ee2-ac1a-97b85f03daa0 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:30.043478 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6291f109-ec91-4ee2-ac1a-97b85f03daa0 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:30.045522 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:30.051914 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6291f109-ec91-4ee2-ac1a-97b85f03daa0 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:30.052357 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6291f109-ec91-4ee2-ac1a-97b85f03daa0 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:30.053133 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6291f109-ec91-4ee2-ac1a-97b85f03daa0 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:30.053560 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6291f109-ec91-4ee2-ac1a-97b85f03daa0 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:30.188235 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6291f109-ec91-4ee2-ac1a-97b85f03daa0 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:30.195905 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6291f109-ec91-4ee2-ac1a-97b85f03daa0 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.161309 Jun 29 08:55:30.196505 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 671/1301] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:30 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:30.661207 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-598b8595-0ba4-424a-8774-a30eb0bc1df1 req-c780e327-93e1-4f09-9e62-f313b3120cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0f715c-4183-40ed-a408-f1de6eaf1ebb", "tag": "6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:55:30.671114 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-598b8595-0ba4-424a-8774-a30eb0bc1df1 req-c780e327-93e1-4f09-9e62-f313b3120cd5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:30.671754 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-598b8595-0ba4-424a-8774-a30eb0bc1df1 req-c780e327-93e1-4f09-9e62-f313b3120cd5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:30.684784 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-598b8595-0ba4-424a-8774-a30eb0bc1df1 req-c780e327-93e1-4f09-9e62-f313b3120cd5 service nova] Creating event network-changed:6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b for instance da0f715c-4183-40ed-a408-f1de6eaf1ebb on hv-cinder-79760 Jun 29 08:55:30.690023 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-598b8595-0ba4-424a-8774-a30eb0bc1df1 req-c780e327-93e1-4f09-9e62-f313b3120cd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033513 Jun 29 08:55:30.690682 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 631/1302] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:55:31.213612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2d1ade77-3b60-4885-9673-e84b523f800e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:31.214222 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2d1ade77-3b60-4885-9673-e84b523f800e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:31.221807 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d1ade77-3b60-4885-9673-e84b523f800e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:31.222260 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d1ade77-3b60-4885-9673-e84b523f800e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:31.223116 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d1ade77-3b60-4885-9673-e84b523f800e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:31.223538 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d1ade77-3b60-4885-9673-e84b523f800e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:31.354521 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2d1ade77-3b60-4885-9673-e84b523f800e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:31.362563 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2d1ade77-3b60-4885-9673-e84b523f800e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.153183 Jun 29 08:55:31.363348 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 672/1303] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:31 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:32.385442 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b7088252-70ad-4a30-86a1-bd903ef06da1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:32.386604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b7088252-70ad-4a30-86a1-bd903ef06da1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:32.394469 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b7088252-70ad-4a30-86a1-bd903ef06da1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:32.394945 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b7088252-70ad-4a30-86a1-bd903ef06da1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:32.395715 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b7088252-70ad-4a30-86a1-bd903ef06da1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:32.396144 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b7088252-70ad-4a30-86a1-bd903ef06da1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:32.551250 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b7088252-70ad-4a30-86a1-bd903ef06da1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:32.562484 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b7088252-70ad-4a30-86a1-bd903ef06da1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.184931 Jun 29 08:55:32.563374 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 632/1304] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:32 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:33.585910 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d1b793b6-93d8-4fc7-beaf-f7d47f94e709 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:33.586525 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d1b793b6-93d8-4fc7-beaf-f7d47f94e709 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:33.594549 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1b793b6-93d8-4fc7-beaf-f7d47f94e709 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:33.595036 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1b793b6-93d8-4fc7-beaf-f7d47f94e709 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:33.595804 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1b793b6-93d8-4fc7-beaf-f7d47f94e709 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:33.596232 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1b793b6-93d8-4fc7-beaf-f7d47f94e709 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:33.729132 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d1b793b6-93d8-4fc7-beaf-f7d47f94e709 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:33.737059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d1b793b6-93d8-4fc7-beaf-f7d47f94e709 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.155349 Jun 29 08:55:33.737631 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 673/1305] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:33 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:34.757756 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3013700b-4ee5-4ff2-9981-9f7a44eed43b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:34.758650 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3013700b-4ee5-4ff2-9981-9f7a44eed43b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:34.767609 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3013700b-4ee5-4ff2-9981-9f7a44eed43b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:34.768054 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3013700b-4ee5-4ff2-9981-9f7a44eed43b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:34.768822 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3013700b-4ee5-4ff2-9981-9f7a44eed43b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:34.769251 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3013700b-4ee5-4ff2-9981-9f7a44eed43b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:34.920376 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3013700b-4ee5-4ff2-9981-9f7a44eed43b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:34.928222 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3013700b-4ee5-4ff2-9981-9f7a44eed43b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.177140 Jun 29 08:55:34.928790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 633/1306] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:34 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:35.947080 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1098463a-60c9-4c51-8ec1-1e47e38fe873 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:35.947857 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1098463a-60c9-4c51-8ec1-1e47e38fe873 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:35.955537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1098463a-60c9-4c51-8ec1-1e47e38fe873 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:35.955984 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1098463a-60c9-4c51-8ec1-1e47e38fe873 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:35.956751 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1098463a-60c9-4c51-8ec1-1e47e38fe873 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:35.957186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1098463a-60c9-4c51-8ec1-1e47e38fe873 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:36.102085 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1098463a-60c9-4c51-8ec1-1e47e38fe873 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:36.109817 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1098463a-60c9-4c51-8ec1-1e47e38fe873 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.167735 Jun 29 08:55:36.110384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 674/1307] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:35 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:37.132352 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-063e68b7-9f4a-4623-b2cf-cd8437005506 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:37.132951 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-063e68b7-9f4a-4623-b2cf-cd8437005506 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:37.141684 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-063e68b7-9f4a-4623-b2cf-cd8437005506 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:37.142303 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-063e68b7-9f4a-4623-b2cf-cd8437005506 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:37.143583 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-063e68b7-9f4a-4623-b2cf-cd8437005506 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:37.144122 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-063e68b7-9f4a-4623-b2cf-cd8437005506 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:37.295533 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-063e68b7-9f4a-4623-b2cf-cd8437005506 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:37.303098 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-063e68b7-9f4a-4623-b2cf-cd8437005506 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.175060 Jun 29 08:55:37.303672 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 634/1308] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:37 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:38.324652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b2e289cf-6e84-45bb-82a3-5cfd9393e3aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:38.325606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b2e289cf-6e84-45bb-82a3-5cfd9393e3aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:38.337503 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2e289cf-6e84-45bb-82a3-5cfd9393e3aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:38.338278 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2e289cf-6e84-45bb-82a3-5cfd9393e3aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:38.339652 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2e289cf-6e84-45bb-82a3-5cfd9393e3aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:38.340369 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b2e289cf-6e84-45bb-82a3-5cfd9393e3aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:38.480606 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b2e289cf-6e84-45bb-82a3-5cfd9393e3aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:38.488585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b2e289cf-6e84-45bb-82a3-5cfd9393e3aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.170378 Jun 29 08:55:38.489144 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 675/1309] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:38 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:39.046210 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-d860e832-3dfe-452d-a24e-ca7028034f6b req-48397839-5c47-409f-96c4-e01a26cfc3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da0f715c-4183-40ed-a408-f1de6eaf1ebb", "name": "network-vif-plugged", "status": "completed", "tag": "6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:55:39.057292 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-d860e832-3dfe-452d-a24e-ca7028034f6b req-48397839-5c47-409f-96c4-e01a26cfc3a7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:39.057921 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-d860e832-3dfe-452d-a24e-ca7028034f6b req-48397839-5c47-409f-96c4-e01a26cfc3a7 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:39.070104 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-d860e832-3dfe-452d-a24e-ca7028034f6b req-48397839-5c47-409f-96c4-e01a26cfc3a7 service nova] Creating event network-vif-plugged:6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b for instance da0f715c-4183-40ed-a408-f1de6eaf1ebb on hv-cinder-79760 Jun 29 08:55:39.075167 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-d860e832-3dfe-452d-a24e-ca7028034f6b req-48397839-5c47-409f-96c4-e01a26cfc3a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Jun 29 08:55:39.075788 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 635/1310] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:55:39.506954 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ce43cfb1-c12f-4ba1-b94f-b1f3352f764d tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:39.507588 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ce43cfb1-c12f-4ba1-b94f-b1f3352f764d tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:39.514477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce43cfb1-c12f-4ba1-b94f-b1f3352f764d tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:39.514953 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce43cfb1-c12f-4ba1-b94f-b1f3352f764d tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:39.515811 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce43cfb1-c12f-4ba1-b94f-b1f3352f764d tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:39.516246 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce43cfb1-c12f-4ba1-b94f-b1f3352f764d tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:39.646079 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ce43cfb1-c12f-4ba1-b94f-b1f3352f764d tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:39.653651 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ce43cfb1-c12f-4ba1-b94f-b1f3352f764d tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.150687 Jun 29 08:55:39.654226 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 676/1311] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:39 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:40.676934 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-3b3714d8-ab42-430c-a861-81cf6cb24d39 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:40.678093 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-3b3714d8-ab42-430c-a861-81cf6cb24d39 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:40.689150 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3b3714d8-ab42-430c-a861-81cf6cb24d39 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:40.689595 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3b3714d8-ab42-430c-a861-81cf6cb24d39 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:40.690370 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3b3714d8-ab42-430c-a861-81cf6cb24d39 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:40.690914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-3b3714d8-ab42-430c-a861-81cf6cb24d39 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:40.841542 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-3b3714d8-ab42-430c-a861-81cf6cb24d39 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:40.849793 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-3b3714d8-ab42-430c-a861-81cf6cb24d39 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1359 microversion: 2.1 time: 0.181011 Jun 29 08:55:40.850384 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 636/1312] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:40 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:41.869809 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5cc71c60-79b5-4522-8dfe-3f5df1326003 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:41.870402 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5cc71c60-79b5-4522-8dfe-3f5df1326003 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:41.877469 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5cc71c60-79b5-4522-8dfe-3f5df1326003 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:41.877910 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5cc71c60-79b5-4522-8dfe-3f5df1326003 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:41.878671 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5cc71c60-79b5-4522-8dfe-3f5df1326003 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:41.879129 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5cc71c60-79b5-4522-8dfe-3f5df1326003 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:42.019194 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5cc71c60-79b5-4522-8dfe-3f5df1326003 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:42.026717 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5cc71c60-79b5-4522-8dfe-3f5df1326003 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1550 microversion: 2.1 time: 0.160927 Jun 29 08:55:42.027514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 677/1313] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:41 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:42.043665 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-80bcb7c8-bac1-46f1-8dba-ef247bb906d7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:42.044250 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-80bcb7c8-bac1-46f1-8dba-ef247bb906d7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:42.051143 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-80bcb7c8-bac1-46f1-8dba-ef247bb906d7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:42.051642 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-80bcb7c8-bac1-46f1-8dba-ef247bb906d7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:42.052347 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-80bcb7c8-bac1-46f1-8dba-ef247bb906d7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:42.052775 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-80bcb7c8-bac1-46f1-8dba-ef247bb906d7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:42.183594 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-80bcb7c8-bac1-46f1-8dba-ef247bb906d7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:42.192147 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-80bcb7c8-bac1-46f1-8dba-ef247bb906d7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1550 microversion: 2.1 time: 0.152530 Jun 29 08:55:42.192687 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 637/1314] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:42 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:42.208125 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:42.211630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:42.212742 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Searching by: {'deleted': False, 'project_id': '50a457f985c4496ca41152bfa29ae9e3'} {{(pid=124266) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 29 08:55:42.220010 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:42.220449 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:42.221237 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:42.221668 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:42.313405 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.multi_cell_list [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124266) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 29 08:55:42.407855 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-887b2cf2-8646-41fe-bd50-e0f646a46969 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203441 Jun 29 08:55:42.408454 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 678/1315] 10.222.0.27 () {58 vars in 1124 bytes} [Wed Jun 29 08:55:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:55:42.422301 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9c24aaa7-280f-450d-8cf0-ea476036ff07 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:42.422967 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9c24aaa7-280f-450d-8cf0-ea476036ff07 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:42.429584 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9c24aaa7-280f-450d-8cf0-ea476036ff07 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:42.430035 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9c24aaa7-280f-450d-8cf0-ea476036ff07 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:42.430849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9c24aaa7-280f-450d-8cf0-ea476036ff07 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:42.431278 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9c24aaa7-280f-450d-8cf0-ea476036ff07 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:42.560604 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9c24aaa7-280f-450d-8cf0-ea476036ff07 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:42.568458 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9c24aaa7-280f-450d-8cf0-ea476036ff07 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1550 microversion: 2.1 time: 0.152714 Jun 29 08:55:42.568931 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 638/1316] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:42 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:44.105310 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-59f21321-e571-4d27-89be-e106e728dd8e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7724b9b5-9c82-4174-9fac-1711a2068b41"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:55:44.106384 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-59f21321-e571-4d27-89be-e106e728dd8e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:44.113262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59f21321-e571-4d27-89be-e106e728dd8e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:44.113699 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59f21321-e571-4d27-89be-e106e728dd8e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:44.114455 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59f21321-e571-4d27-89be-e106e728dd8e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:44.114926 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59f21321-e571-4d27-89be-e106e728dd8e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:44.403084 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-59f21321-e571-4d27-89be-e106e728dd8e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "POST /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301535 Jun 29 08:55:44.408750 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 679/1317] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Jun 29 08:55:44 2022] POST /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:55:52.018979 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b3357004-57a1-40ce-95fb-5331ae0fde4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:52.019882 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b3357004-57a1-40ce-95fb-5331ae0fde4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:52.023819 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:52.031448 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b3357004-57a1-40ce-95fb-5331ae0fde4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:52.031864 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b3357004-57a1-40ce-95fb-5331ae0fde4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:52.032705 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b3357004-57a1-40ce-95fb-5331ae0fde4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:52.033099 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b3357004-57a1-40ce-95fb-5331ae0fde4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:52.036652 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=73 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:52.183245 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-b3357004-57a1-40ce-95fb-5331ae0fde4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:52.195706 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b3357004-57a1-40ce-95fb-5331ae0fde4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1596 microversion: 2.1 time: 0.182515 Jun 29 08:55:52.196466 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 639/1318] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:52 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1596 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:53.932677 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-e420d20c-b192-4961-9dea-14ce077fd457 req-cab7bcfb-72a2-466a-a314-cffa850cdc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0f715c-4183-40ed-a408-f1de6eaf1ebb", "tag": "6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:55:53.936899 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:53.937729 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:53.943869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e420d20c-b192-4961-9dea-14ce077fd457 req-cab7bcfb-72a2-466a-a314-cffa850cdc60 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:53.944299 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e420d20c-b192-4961-9dea-14ce077fd457 req-cab7bcfb-72a2-466a-a314-cffa850cdc60 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:53.949147 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:55:53.958316 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-e420d20c-b192-4961-9dea-14ce077fd457 req-cab7bcfb-72a2-466a-a314-cffa850cdc60 service nova] Creating event network-changed:6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b for instance da0f715c-4183-40ed-a408-f1de6eaf1ebb on hv-cinder-79760 Jun 29 08:55:53.964509 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-e420d20c-b192-4961-9dea-14ce077fd457 req-cab7bcfb-72a2-466a-a314-cffa850cdc60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035618 Jun 29 08:55:53.965127 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 680/1319] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:55:55.104916 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-7eb2178f-eaa0-489d-93a0-5f532fc5bb32 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1908923989"}} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:55:55.105440 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-7eb2178f-eaa0-489d-93a0-5f532fc5bb32 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:55.112515 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7eb2178f-eaa0-489d-93a0-5f532fc5bb32 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:55.112952 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7eb2178f-eaa0-489d-93a0-5f532fc5bb32 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:55.113693 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7eb2178f-eaa0-489d-93a0-5f532fc5bb32 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:55.114112 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-7eb2178f-eaa0-489d-93a0-5f532fc5bb32 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:55.242880 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.network.security_group_api [None req-7eb2178f-eaa0-489d-93a0-5f532fc5bb32 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Adding security group de6d36a9-3572-4a24-b8f3-5688e8ea68be to port 6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b Jun 29 08:55:55.595096 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-7eb2178f-eaa0-489d-93a0-5f532fc5bb32 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "POST /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/action" status: 202 len: 0 microversion: 2.1 time: 0.493920 Jun 29 08:55:55.596201 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 640/1320] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:55:55 2022] POST /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:55:55.605101 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f99f8924-b395-443b-ab20-27085a4084e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:55:55.606586 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f99f8924-b395-443b-ab20-27085a4084e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:55:55.618943 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f99f8924-b395-443b-ab20-27085a4084e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:55.619790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f99f8924-b395-443b-ab20-27085a4084e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:55.620843 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f99f8924-b395-443b-ab20-27085a4084e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:55.620982 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f99f8924-b395-443b-ab20-27085a4084e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:55.790274 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-0f03c6ed-41e7-4d99-838b-b4526b9b68f9 req-94d7223e-1121-4305-97bc-7b95d13d70b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0f715c-4183-40ed-a408-f1de6eaf1ebb", "tag": "6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:55:55.799793 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-0f03c6ed-41e7-4d99-838b-b4526b9b68f9 req-94d7223e-1121-4305-97bc-7b95d13d70b5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:55:55.800220 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-0f03c6ed-41e7-4d99-838b-b4526b9b68f9 req-94d7223e-1121-4305-97bc-7b95d13d70b5 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:55:55.805395 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f99f8924-b395-443b-ab20-27085a4084e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:55:55.814835 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f99f8924-b395-443b-ab20-27085a4084e9 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1761 microversion: 2.1 time: 0.214019 Jun 29 08:55:55.816419 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 681/1321] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:55:55 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1761 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:55:55.821641 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-0f03c6ed-41e7-4d99-838b-b4526b9b68f9 req-94d7223e-1121-4305-97bc-7b95d13d70b5 service nova] Creating event network-changed:6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b for instance da0f715c-4183-40ed-a408-f1de6eaf1ebb on hv-cinder-79760 Jun 29 08:55:55.828983 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-0f03c6ed-41e7-4d99-838b-b4526b9b68f9 req-94d7223e-1121-4305-97bc-7b95d13d70b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224511 Jun 29 08:55:55.831402 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 641/1322] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:56:56.328790 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:56:56.329956 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=7 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:56:56.336553 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c91d2ef8-69f3-4031-85dc-a2f5a6b8ed3c tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:56:56.338501 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c91d2ef8-69f3-4031-85dc-a2f5a6b8ed3c tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:56:56.345913 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c91d2ef8-69f3-4031-85dc-a2f5a6b8ed3c tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:56:56.346355 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c91d2ef8-69f3-4031-85dc-a2f5a6b8ed3c tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:56:56.347145 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c91d2ef8-69f3-4031-85dc-a2f5a6b8ed3c tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:56:56.347570 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c91d2ef8-69f3-4031-85dc-a2f5a6b8ed3c tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:56:56.428614 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c91d2ef8-69f3-4031-85dc-a2f5a6b8ed3c tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "POST /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/action" status: 202 len: 0 microversion: 2.1 time: 0.102745 Jun 29 08:56:56.429236 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 682/1323] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:56:56 2022] POST /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:56:56.436028 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=5 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:56:56.436771 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=11 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:56:56.441496 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-9323418a-5bd6-4a85-8930-a991d46860aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:56:56.442199 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-9323418a-5bd6-4a85-8930-a991d46860aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:56:56.449458 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9323418a-5bd6-4a85-8930-a991d46860aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:56:56.449893 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9323418a-5bd6-4a85-8930-a991d46860aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:56:56.450663 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9323418a-5bd6-4a85-8930-a991d46860aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:56:56.451153 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-9323418a-5bd6-4a85-8930-a991d46860aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:56:56.602856 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-9323418a-5bd6-4a85-8930-a991d46860aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:56:56.610954 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-9323418a-5bd6-4a85-8930-a991d46860aa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1753 microversion: 2.1 time: 0.177121 Jun 29 08:56:56.611513 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 642/1324] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:56:56 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:56:57.635641 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-59ccb5ec-919a-4b6f-9b5b-548c4fd73d3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:56:57.636812 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-59ccb5ec-919a-4b6f-9b5b-548c4fd73d3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:56:57.644720 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ccb5ec-919a-4b6f-9b5b-548c4fd73d3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:56:57.645166 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ccb5ec-919a-4b6f-9b5b-548c4fd73d3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:56:57.645930 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ccb5ec-919a-4b6f-9b5b-548c4fd73d3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:56:57.646366 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ccb5ec-919a-4b6f-9b5b-548c4fd73d3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:56:57.803103 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-59ccb5ec-919a-4b6f-9b5b-548c4fd73d3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:56:57.815492 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-59ccb5ec-919a-4b6f-9b5b-548c4fd73d3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.188039 Jun 29 08:56:57.816272 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 683/1325] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:56:57 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:56:58.841528 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-4a2ce0c7-e1f8-42bd-93b3-65f3521388bf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:56:58.842328 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-4a2ce0c7-e1f8-42bd-93b3-65f3521388bf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:56:58.849108 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a2ce0c7-e1f8-42bd-93b3-65f3521388bf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:56:58.849553 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a2ce0c7-e1f8-42bd-93b3-65f3521388bf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:56:58.850314 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a2ce0c7-e1f8-42bd-93b3-65f3521388bf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:56:58.850737 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-4a2ce0c7-e1f8-42bd-93b3-65f3521388bf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:56:59.076190 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-4a2ce0c7-e1f8-42bd-93b3-65f3521388bf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:56:59.084768 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-4a2ce0c7-e1f8-42bd-93b3-65f3521388bf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.250359 Jun 29 08:56:59.085373 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 643/1326] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:56:58 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:57:00.107139 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2b0733d6-02d2-43b1-8ac4-e298b88a8ebf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:57:00.108132 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2b0733d6-02d2-43b1-8ac4-e298b88a8ebf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:57:00.119119 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b0733d6-02d2-43b1-8ac4-e298b88a8ebf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:00.119846 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b0733d6-02d2-43b1-8ac4-e298b88a8ebf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:00.121075 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b0733d6-02d2-43b1-8ac4-e298b88a8ebf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:00.121783 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b0733d6-02d2-43b1-8ac4-e298b88a8ebf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:00.270091 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2b0733d6-02d2-43b1-8ac4-e298b88a8ebf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:57:00.278156 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2b0733d6-02d2-43b1-8ac4-e298b88a8ebf tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.177779 Jun 29 08:57:00.278847 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 684/1327] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:57:00 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:57:01.299487 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-73c1c40a-1172-4fd6-9d81-264cec3b02e3 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:57:01.300128 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-73c1c40a-1172-4fd6-9d81-264cec3b02e3 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:57:01.307120 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-73c1c40a-1172-4fd6-9d81-264cec3b02e3 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:01.307564 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-73c1c40a-1172-4fd6-9d81-264cec3b02e3 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:01.308325 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-73c1c40a-1172-4fd6-9d81-264cec3b02e3 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:01.308757 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-73c1c40a-1172-4fd6-9d81-264cec3b02e3 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:01.459377 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-73c1c40a-1172-4fd6-9d81-264cec3b02e3 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:57:01.471461 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-73c1c40a-1172-4fd6-9d81-264cec3b02e3 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.177991 Jun 29 08:57:01.472212 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 644/1328] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:57:01 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:57:02.118127 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:57:02.118551 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 08:57:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:57:02.493762 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-286a05da-4b7b-4e46-9c4a-df5d66352427 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:57:02.494378 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-286a05da-4b7b-4e46-9c4a-df5d66352427 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:57:02.501458 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-286a05da-4b7b-4e46-9c4a-df5d66352427 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:02.501904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-286a05da-4b7b-4e46-9c4a-df5d66352427 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:02.502671 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-286a05da-4b7b-4e46-9c4a-df5d66352427 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:02.503148 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-286a05da-4b7b-4e46-9c4a-df5d66352427 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:02.655303 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-286a05da-4b7b-4e46-9c4a-df5d66352427 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:57:02.668161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-286a05da-4b7b-4e46-9c4a-df5d66352427 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.178124 Jun 29 08:57:02.669032 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 685/1329] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:57:02 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:57:03.691006 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d979f947-4a16-41cf-95ca-ae78e79a0ace tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:57:03.691931 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d979f947-4a16-41cf-95ca-ae78e79a0ace tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:57:03.702935 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d979f947-4a16-41cf-95ca-ae78e79a0ace tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:03.703661 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d979f947-4a16-41cf-95ca-ae78e79a0ace tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:03.704944 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d979f947-4a16-41cf-95ca-ae78e79a0ace tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:03.705362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d979f947-4a16-41cf-95ca-ae78e79a0ace tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:03.857977 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-d979f947-4a16-41cf-95ca-ae78e79a0ace tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:57:03.866122 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d979f947-4a16-41cf-95ca-ae78e79a0ace tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.181921 Jun 29 08:57:03.866657 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 645/1330] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:57:03 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:57:04.886979 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1b953151-f7f8-4149-b1d6-02ed8b61d918 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:57:04.888007 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1b953151-f7f8-4149-b1d6-02ed8b61d918 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:57:04.896706 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b953151-f7f8-4149-b1d6-02ed8b61d918 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:04.897143 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b953151-f7f8-4149-b1d6-02ed8b61d918 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:04.897891 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b953151-f7f8-4149-b1d6-02ed8b61d918 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:04.898314 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b953151-f7f8-4149-b1d6-02ed8b61d918 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:05.059186 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1b953151-f7f8-4149-b1d6-02ed8b61d918 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:57:05.067288 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1b953151-f7f8-4149-b1d6-02ed8b61d918 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.187016 Jun 29 08:57:05.067851 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 686/1331] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:57:04 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:57:06.089478 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0bd5fbc6-c6a7-4618-a757-3509de524acc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:57:06.090432 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0bd5fbc6-c6a7-4618-a757-3509de524acc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:57:06.099357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0bd5fbc6-c6a7-4618-a757-3509de524acc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:06.099798 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0bd5fbc6-c6a7-4618-a757-3509de524acc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:06.100559 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0bd5fbc6-c6a7-4618-a757-3509de524acc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:06.100990 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0bd5fbc6-c6a7-4618-a757-3509de524acc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:06.254679 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0bd5fbc6-c6a7-4618-a757-3509de524acc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:57:06.263367 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0bd5fbc6-c6a7-4618-a757-3509de524acc tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.180742 Jun 29 08:57:06.264094 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 646/1332] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:57:06 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:57:07.285581 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7e6b890c-79ef-4a2b-b234-0cc3f53696da tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:57:07.286483 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7e6b890c-79ef-4a2b-b234-0cc3f53696da tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:57:07.297618 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e6b890c-79ef-4a2b-b234-0cc3f53696da tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:07.298591 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e6b890c-79ef-4a2b-b234-0cc3f53696da tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:07.299634 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e6b890c-79ef-4a2b-b234-0cc3f53696da tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:07.300080 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e6b890c-79ef-4a2b-b234-0cc3f53696da tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:07.510262 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e6b890c-79ef-4a2b-b234-0cc3f53696da tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:57:07.522967 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7e6b890c-79ef-4a2b-b234-0cc3f53696da tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1758 microversion: 2.1 time: 0.243743 Jun 29 08:57:07.523734 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 687/1333] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:57:07 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1758 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:57:08.544315 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-846c9e97-1607-4abd-abad-8c52873db9c7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:57:08.544909 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-846c9e97-1607-4abd-abad-8c52873db9c7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:57:08.552308 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-846c9e97-1607-4abd-abad-8c52873db9c7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:08.552802 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-846c9e97-1607-4abd-abad-8c52873db9c7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:08.553601 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-846c9e97-1607-4abd-abad-8c52873db9c7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:57:08.554032 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-846c9e97-1607-4abd-abad-8c52873db9c7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:57:08.700603 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-846c9e97-1607-4abd-abad-8c52873db9c7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:57:08.708733 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-846c9e97-1607-4abd-abad-8c52873db9c7 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1761 microversion: 2.1 time: 0.168417 Jun 29 08:57:08.709293 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 647/1334] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:57:08 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:58:11.876161 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=12 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:58:11.876951 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:58:11.881911 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e76706d9-0770-480a-8a3b-414123c4cda8 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1908923989"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:58:11.882441 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e76706d9-0770-480a-8a3b-414123c4cda8 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:11.889884 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e76706d9-0770-480a-8a3b-414123c4cda8 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:11.890330 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e76706d9-0770-480a-8a3b-414123c4cda8 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:11.891138 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e76706d9-0770-480a-8a3b-414123c4cda8 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:11.891570 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e76706d9-0770-480a-8a3b-414123c4cda8 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:12.031732 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.network.security_group_api [None req-e76706d9-0770-480a-8a3b-414123c4cda8 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Removing security group de6d36a9-3572-4a24-b8f3-5688e8ea68be from port 6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b Jun 29 08:58:12.400612 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e76706d9-0770-480a-8a3b-414123c4cda8 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "POST /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/action" status: 202 len: 0 microversion: 2.1 time: 0.527223 Jun 29 08:58:12.401500 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 688/1335] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Jun 29 08:58:11 2022] POST /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:58:12.415626 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_api:SELECT=12 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:58:12.416854 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG dbcounter [-] [124265] Writing DB stats nova_cell1:SELECT=36 {{(pid=124265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:58:12.429126 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-2d9ea039-3100-4590-9b52-3cc3a1cc9543 req-f0caac50-6269-4b6f-b8c6-7517c17ead4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0f715c-4183-40ed-a408-f1de6eaf1ebb", "tag": "6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:58:12.457243 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-2d9ea039-3100-4590-9b52-3cc3a1cc9543 req-f0caac50-6269-4b6f-b8c6-7517c17ead4b service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:12.466682 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-2d9ea039-3100-4590-9b52-3cc3a1cc9543 req-f0caac50-6269-4b6f-b8c6-7517c17ead4b service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:12.509908 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-2d9ea039-3100-4590-9b52-3cc3a1cc9543 req-f0caac50-6269-4b6f-b8c6-7517c17ead4b service nova] Creating event network-changed:6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b for instance da0f715c-4183-40ed-a408-f1de6eaf1ebb on hv-cinder-79760 Jun 29 08:58:12.520256 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-2d9ea039-3100-4590-9b52-3cc3a1cc9543 req-f0caac50-6269-4b6f-b8c6-7517c17ead4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105842 Jun 29 08:58:12.525777 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 648/1336] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:58:13.519953 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-588a9211-ca7b-47e5-a67c-919531ecc3b4 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:13.520656 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-588a9211-ca7b-47e5-a67c-919531ecc3b4 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:13.527059 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-588a9211-ca7b-47e5-a67c-919531ecc3b4 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:13.527579 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-588a9211-ca7b-47e5-a67c-919531ecc3b4 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:13.528438 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-588a9211-ca7b-47e5-a67c-919531ecc3b4 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:13.528935 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-588a9211-ca7b-47e5-a67c-919531ecc3b4 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:13.611714 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-588a9211-ca7b-47e5-a67c-919531ecc3b4 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lazy-loading 'services' on Instance uuid da0f715c-4183-40ed-a408-f1de6eaf1ebb {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:58:13.689066 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-588a9211-ca7b-47e5-a67c-919531ecc3b4 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments/7724b9b5-9c82-4174-9fac-1711a2068b41" status: 202 len: 0 microversion: 2.1 time: 0.173944 Jun 29 08:58:13.689890 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 689/1337] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:58:13 2022] DELETE /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments/7724b9b5-9c82-4174-9fac-1711a2068b41 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:58:13.699191 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-6133bd75-f853-4f26-861a-25ebfae92eca tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:13.700256 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-6133bd75-f853-4f26-861a-25ebfae92eca tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:13.708155 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6133bd75-f853-4f26-861a-25ebfae92eca tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:13.708767 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6133bd75-f853-4f26-861a-25ebfae92eca tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:13.709524 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6133bd75-f853-4f26-861a-25ebfae92eca tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:13.709951 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-6133bd75-f853-4f26-861a-25ebfae92eca tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:13.740378 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-6133bd75-f853-4f26-861a-25ebfae92eca tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045383 Jun 29 08:58:13.740913 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 649/1338] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:58:13 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:58:14.540694 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-10c5d816-a530-4a63-97d5-28c30bc9c601 req-2a81940e-47b6-465c-b899-54045d62645d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0f715c-4183-40ed-a408-f1de6eaf1ebb", "tag": "6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:58:14.549848 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-10c5d816-a530-4a63-97d5-28c30bc9c601 req-2a81940e-47b6-465c-b899-54045d62645d service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:14.550275 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-10c5d816-a530-4a63-97d5-28c30bc9c601 req-2a81940e-47b6-465c-b899-54045d62645d service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:14.562572 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-10c5d816-a530-4a63-97d5-28c30bc9c601 req-2a81940e-47b6-465c-b899-54045d62645d service nova] Creating event network-changed:6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b for instance da0f715c-4183-40ed-a408-f1de6eaf1ebb on hv-cinder-79760 Jun 29 08:58:14.567477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-10c5d816-a530-4a63-97d5-28c30bc9c601 req-2a81940e-47b6-465c-b899-54045d62645d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031997 Jun 29 08:58:14.568080 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 690/1339] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:58:14.753055 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-d0c3f258-e0ba-494e-81a6-01d59797e268 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:14.754073 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-d0c3f258-e0ba-494e-81a6-01d59797e268 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:14.762230 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d0c3f258-e0ba-494e-81a6-01d59797e268 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:14.762797 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d0c3f258-e0ba-494e-81a6-01d59797e268 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:14.763574 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d0c3f258-e0ba-494e-81a6-01d59797e268 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:14.763978 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-d0c3f258-e0ba-494e-81a6-01d59797e268 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:14.795779 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-d0c3f258-e0ba-494e-81a6-01d59797e268 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046821 Jun 29 08:58:14.796357 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 650/1340] 10.222.0.27 () {58 vars in 1301 bytes} [Wed Jun 29 08:58:14 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:58:14.807053 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:14.807624 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:14.814236 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:14.814679 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:14.815461 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:14.815893 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:14.891585 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] HTTP exception thrown: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb is not attached to volume 7724b9b5-9c82-4174-9fac-1711a2068b41 Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Request method failure captured: Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments/7724b9b5-9c82-4174-9fac-1711a2068b41 HTTP/1.1 Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBNmjvRaeUcjCQgIf_ngOcvtB9zEzDLQj88AzGDK_n1UH630pagKOjInoq8WVozQGITMFQoMvWuFRkKmRfP5XnvEeN6WvimQiPJoQmEmA6J6gdBBotyMkHWoXcQVagq1doS1oGJeMIr0FOJB3LWPv7R34XVCyEZl3TgppqwWrpRKreI Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 50a457f985c4496ca41152bfa29ae9e3 Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestMinimumBasicScenario-724854940 Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:58:14.893904 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50a457f985c4496ca41152bfa29ae9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50a457f985c4496ca41152bfa29ae9e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50a457f985c4496ca41152bfa29ae9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50a457f985c4496ca41152bfa29ae9e3"}]}] Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestMinimumBasicScenario-724854940 Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 50a457f985c4496ca41152bfa29ae9e3 Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestMinimumBasicScenario-724854940 Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-TestMinimumBasicScenario-724854940-project Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 340cc4d0b4c543fab577749f947598b1 Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestMinimumBasicScenario-724854940-project Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:58:14.895869 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb is not attached to volume 7724b9b5-9c82-4174-9fac-1711a2068b41 Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'server_id': 'da0f715c-4183-40ed-a408-f1de6eaf1ebb', 'id': '7724b9b5-9c82-4174-9fac-1711a2068b41'} Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7724b9b5-9c82-4174-9fac-1711a2068b41. Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:58:14.896860 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb is not attached to volume 7724b9b5-9c82-4174-9fac-1711a2068b41 Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb is not attached to volume 7724b9b5-9c82-4174-9fac-1711a2068b41 Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:14.898537 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Returning 404 to user: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb is not attached to volume 7724b9b5-9c82-4174-9fac-1711a2068b41 {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:58:14.901163 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0b295a9d-d8ef-44e9-bacb-18e33d3169de tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments/7724b9b5-9c82-4174-9fac-1711a2068b41" status: 404 len: 154 microversion: 2.1 time: 0.092814 Jun 29 08:58:14.901163 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 691/1341] 10.222.0.27 () {58 vars in 1415 bytes} [Wed Jun 29 08:58:14 2022] DELETE /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb/os-volume_attachments/7724b9b5-9c82-4174-9fac-1711a2068b41 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:58:16.051567 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-b6da7df7-bb7c-4a83-9578-1f72775080fa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:16.052100 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b6da7df7-bb7c-4a83-9578-1f72775080fa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:16.061634 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b6da7df7-bb7c-4a83-9578-1f72775080fa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:16.062214 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b6da7df7-bb7c-4a83-9578-1f72775080fa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:16.063297 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b6da7df7-bb7c-4a83-9578-1f72775080fa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:16.063790 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-b6da7df7-bb7c-4a83-9578-1f72775080fa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:16.091745 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-b6da7df7-bb7c-4a83-9578-1f72775080fa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Going to try to terminate instance {{(pid=124265) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:58:16.180069 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-b6da7df7-bb7c-4a83-9578-1f72775080fa tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 204 len: 0 microversion: 2.1 time: 0.134490 Jun 29 08:58:16.180904 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 651/1342] 10.222.0.27 () {58 vars in 1238 bytes} [Wed Jun 29 08:58:16 2022] DELETE /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:58:16.189842 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1b4e1e26-c3ab-48ad-975a-7684a4857a23 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:16.190467 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1b4e1e26-c3ab-48ad-975a-7684a4857a23 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:16.197118 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b4e1e26-c3ab-48ad-975a-7684a4857a23 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:16.197561 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b4e1e26-c3ab-48ad-975a-7684a4857a23 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:16.198332 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b4e1e26-c3ab-48ad-975a-7684a4857a23 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:16.198793 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1b4e1e26-c3ab-48ad-975a-7684a4857a23 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:16.335330 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1b4e1e26-c3ab-48ad-975a-7684a4857a23 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:58:16.351037 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1b4e1e26-c3ab-48ad-975a-7684a4857a23 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1556 microversion: 2.1 time: 0.165065 Jun 29 08:58:16.351617 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 692/1343] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:58:16 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:58:17.373676 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-0abe160c-3880-45ad-b683-9e1508e525d1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:17.374963 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.compute.api [None req-0abe160c-3880-45ad-b683-9e1508e525d1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124265) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:17.385756 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0abe160c-3880-45ad-b683-9e1508e525d1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:17.386493 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0abe160c-3880-45ad-b683-9e1508e525d1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:17.387800 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0abe160c-3880-45ad-b683-9e1508e525d1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:17.388519 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [None req-0abe160c-3880-45ad-b683-9e1508e525d1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:17.530522 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.policy [None req-0abe160c-3880-45ad-b683-9e1508e525d1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124265) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:58:17.540849 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-0abe160c-3880-45ad-b683-9e1508e525d1 tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1556 microversion: 2.1 time: 0.174388 Jun 29 08:58:17.541453 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 652/1344] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:58:17 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:58:18.562927 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b6d51041-bf76-48ee-8f56-52b851c796bb tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:18.563514 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b6d51041-bf76-48ee-8f56-52b851c796bb tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:18.570486 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6d51041-bf76-48ee-8f56-52b851c796bb tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:18.570965 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6d51041-bf76-48ee-8f56-52b851c796bb tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:18.571728 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6d51041-bf76-48ee-8f56-52b851c796bb tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:18.572157 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6d51041-bf76-48ee-8f56-52b851c796bb tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:18.708628 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b6d51041-bf76-48ee-8f56-52b851c796bb tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cc4d0b4c543fab577749f947598b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a457f985c4496ca41152bfa29ae9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:58:18.716758 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b6d51041-bf76-48ee-8f56-52b851c796bb tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 200 len: 1556 microversion: 2.1 time: 0.157815 Jun 29 08:58:18.717325 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 693/1345] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:58:18 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:58:18.880479 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [req-b29fc023-9198-408d-a99c-6e0fa9ebb0d6 req-b79816f8-6e0f-41ae-b037-a4ec9d829187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da0f715c-4183-40ed-a408-f1de6eaf1ebb", "name": "network-vif-deleted", "tag": "6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b"}]} {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:58:18.889294 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-b29fc023-9198-408d-a99c-6e0fa9ebb0d6 req-b79816f8-6e0f-41ae-b037-a4ec9d829187 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:18.889724 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG oslo_concurrency.lockutils [req-b29fc023-9198-408d-a99c-6e0fa9ebb0d6 req-b79816f8-6e0f-41ae-b037-a4ec9d829187 service nova] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:18.901116 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.compute.server_external_events [req-b29fc023-9198-408d-a99c-6e0fa9ebb0d6 req-b79816f8-6e0f-41ae-b037-a4ec9d829187 service nova] Creating event network-vif-deleted:6cea2637-2f04-4c9b-bbeb-7c4ea6fc448b for instance da0f715c-4183-40ed-a408-f1de6eaf1ebb on hv-cinder-79760 Jun 29 08:58:18.905914 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [req-b29fc023-9198-408d-a99c-6e0fa9ebb0d6 req-b79816f8-6e0f-41ae-b037-a4ec9d829187 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116694 Jun 29 08:58:18.906457 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 653/1346] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Jun 29 08:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:58:19.735139 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:19.736020 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] [instance: da0f715c-4183-40ed-a408-f1de6eaf1ebb] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:58:19.744613 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:19.745349 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:19.746630 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:58:19.747573 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Lock "7545d786-af29-40a6-b32b-77c663f0f8d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:58:19.764932 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] HTTP exception thrown: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb could not be found. Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Request method failure captured: Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb HTTP/1.1 Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept: application/json Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Connection: close Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Length: 0 Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Content-Type: application/json Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Host: 10.222.0.27 Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABivBNmjvRaeUcjCQgIf_ngOcvtB9zEzDLQj88AzGDK_n1UH630pagKOjInoq8WVozQGITMFQoMvWuFRkKmRfP5XnvEeN6WvimQiPJoQmEmA6J6gdBBotyMkHWoXcQVagq1doS1oGJeMIr0FOJB3LWPv7R34XVCyEZl3TgppqwWrpRKreI Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Id: None Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Domain-Name: None Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Id: 50a457f985c4496ca41152bfa29ae9e3 Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestMinimumBasicScenario-724854940 Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Role: reader,member Jun 29 08:58:19.766477 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Roles: reader,member Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50a457f985c4496ca41152bfa29ae9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50a457f985c4496ca41152bfa29ae9e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50a457f985c4496ca41152bfa29ae9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50a457f985c4496ca41152bfa29ae9e3"}]}] Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestMinimumBasicScenario-724854940 Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 50a457f985c4496ca41152bfa29ae9e3 Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestMinimumBasicScenario-724854940 Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User: tempest-TestMinimumBasicScenario-724854940-project Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Id: 340cc4d0b4c543fab577749f947598b1 Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestMinimumBasicScenario-724854940-project Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: method: > Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: exception: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb could not be found. Jun 29 08:58:19.768271 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: action_args: {'id': 'da0f715c-4183-40ed-a408-f1de6eaf1ebb'} Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb could not be found. Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:58:19.769545 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb could not be found. Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb could not be found. Jun 29 08:58:19.771234 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Jun 29 08:58:19.772831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Returning 404 to user: Instance da0f715c-4183-40ed-a408-f1de6eaf1ebb could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:58:19.772831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-51c24503-aef4-422e-8ebc-c443db587a3b tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb" status: 404 len: 111 microversion: 2.1 time: 0.036931 Jun 29 08:58:19.772831 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 694/1347] 10.222.0.27 () {58 vars in 1235 bytes} [Wed Jun 29 08:58:19 2022] GET /compute/v2.1/servers/da0f715c-4183-40ed-a408-f1de6eaf1ebb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:58:19.777817 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: DEBUG nova.api.openstack.wsgi [None req-bb2dd8b0-bfd9-4a5c-9813-48df696d4a4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] Calling method '.version_select at 0x7fade4372670>' {{(pid=124265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:58:19.805517 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO nova.api.openstack.requestlog [None req-bb2dd8b0-bfd9-4a5c-9813-48df696d4a4e tempest-TestMinimumBasicScenario-724854940 tempest-TestMinimumBasicScenario-724854940-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1641872344" status: 202 len: 0 microversion: 2.1 time: 0.031884 Jun 29 08:58:19.806082 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: [pid: 124265|app: 0|req: 654/1348] 10.222.0.27 () {58 vars in 1271 bytes} [Wed Jun 29 08:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1641872344 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:58:37.642292 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:58:37.643233 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Wed Jun 29 08:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:58:41.503387 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:58:41.504318 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Wed Jun 29 08:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 09:00:21.201992 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 09:00:21.203017 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 09:00:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 09:00:52.571104 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 09:00:52.571982 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Wed Jun 29 09:00:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 09:00:52.806057 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 09:00:52.806923 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 09:00:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 09:01:57.656034 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 09:01:57.656983 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Wed Jun 29 09:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 09:02:01.516240 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 09:02:01.516803 dv-cinder-797608-37-iscsi devstack@n-api.service[124266]: Wed Jun 29 09:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 09:03:41.216310 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 09:03:41.217362 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 09:03:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 09:03:42.136101 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 09:03:42.136431 dv-cinder-797608-37-iscsi devstack@n-api.service[124265]: Wed Jun 29 09:03:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!